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Hon.  Alfred  G.  Chiantelli,  Presiding  Judge 
San  Francisco  Superior  Court 
400  McAllister  Street 
San  Francisco,  CA  94102-4514 

Dear  Judge  Chiantelli: 

The  Controller’s  Audits  Division  presents  its  performance  audit  report  concerning  the 
Adult  Probation  Department  (Department)  of  the  City  and  County  of  San  Francisco  (City). 

This  report  concludes  that  the  Department  does  not  adequately  supervise  probationers,  and 
a recent  reorganization  of  the  Department  may  decrease  supervision.  Poor  management  of 
collections  deprives  victims,  the  City,  and  the  State  of  California  of  money  owed  them; 
planning  and  reporting  processes  are  inadequate  to  guide  the  Department’s  operations;  and 
lack  of  oversight  and  weak  management  controls  for  the  Department  expose  the  City,  the 
Superior  Court  (Court),  and  the  public  to  unnecessary  risk. 

The  report  finds  that  the  Department  needs  to  be  accountable  for  results  and  improve  its 
operations.  Specifically,  it  recommends  that  the  Court  establish  a formal  system  to  oversee 
the  Department,  and  the  Department,  with  the  Court’s  oversight,  establish  a management 
improvement  plan  containing  short  and  long  term  objectives,  specific  action  steps,  and 
regular  progress  reports  to  the  Court.  The  report  further  recommends  that  the  Department 
develop  management  controls,  build  its  ability  to  implement  goals  and  objectives,  and 
undertake  a comprehensive  revision  of  departmental  policies  and  procedures.  The  report 
also  recommends  the  Department  strengthen  its  process  for  collecting  financial  obligations 
from  probationers,  including  contracting  with  an  outside  entity  to  collect  on  delinquent 
accounts. 

Responses  from  the  Court  and  the  Department  are  attached  to  this  report.  The  Controller’s 
Audits  Division  will  be  working  with  the  Department  to  follow  up  on  the  status  of  the 
recommendations  made  in  this  report. 
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EXECUTIVE  SUMMARY 


Results  in  Brief 


The  Adult  Probation  Department  (Department)  of  the  City 
and  County  of  San  Francisco  (City)  lacks  the  management 
and  information  systems  necessary  to  ensure  the 
Department’s  adequate  supervision  of  probationers,  who 
are  criminal  offenders  who  receive  sentences  requiring 
monitoring  by  probation  officers  rather  than  sentences 
involving  incarceration.  As  a result,  some  offenders  who 
may  have  committed  serious  crimes  are  not  complying  with 
important  court-ordered  conditions  of  their  probation. 

These  probationers  could  potentially  jeopardize  public 
safety,  create  liability  for  the  City,  and  deprive  the  City,  the 
State  of  California  (State),  and  crime  victims  of  the  fines 
and  restitution  that  the  probationers  owe. 

Many  of  the  problems  the  audit  identifies  originated  under 
the  previous  chief  adult  probation  officer  (chief),  who 
retired  in  July  1997  after  18  years  in  the  position.  To 
improve  its  ability  to  serve  and  protect  the  citizens  of  San 
Francisco  and  focus  the  current  chiefs  efforts  to  address 
problem  areas,  the  Department  needs  to  develop 
comprehensive  management  controls,  improve  its  use  of 
automated  information  systems,  and  restructure  its 
operations  in  the  following  areas: 

Supervision  of  probationers. 

Currently,  the  Department  does  not  know  how  many  adult 
criminal  offenders  are  under  its  supervision,  and  it  lacks  a 
systematic  method  for  tracking  probationers’  compliance 
with  court-ordered  conditions  of  probation.  Further,  a 
serious  weakness  in  the  Department’s  recent  reorganization 
may  allow  thousands  of  probationers  to  complete  their 
sentences  without  complying  with  probation  conditions. 

Collection  of  fines,  fees,  and  restitution  from  probationers. 
The  Department  has  lost  significant  revenues  because  it  has 
inadequate  processes  for  assessing  and  verifying  a 
probationer’s  ability  to  pay  fines  and  fees  as  ordered  by  the 
court  as  well  as  for  collecting  payments  from  probationers. 
Missing  and  inaccurate  information  in  the  Department's 
accounting  system  could  be  costing  the  Department  and  the 
City  more  than  $360,000  per  year. 
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Background 


Planning  and  reporting. 

The  Department  lacks  adequate  management  controls,  a 
strategic  planning  process,  and  an  effective  means  to 
measure  and  report  its  accomplishments  to  the  state 
Superior  Court  for  the  County  of  San  Francisco  (Court)  and 
to  the  San  Francisco  Board  of  Supervisors  (Board),  which 
are  entities  that  should  evaluate  the  Department’s 
performance.  Moreover,  the  data  collected  manually  by  the 
Department  are  not  reliable. 

Oversight  bv  both  the  City  and  the  State. 

Because  the  Department  receives  only  partial  direction 
from  two  different  entities — the  City’s  Board  of 
Supervisors  and  the  State’s  Superior  Court — it  is  not 
clearly  accountable  to  a single  authority  for  the  supervision 
of  probationers. 

San  Francisco’s  Adult  Probation  Department  supervises 
adult  offenders  who  receive  sentences  of  probation,  which 
is  an  alternative  to  incarceration  that  allows  convicted 
offenders  to  remain  in  the  community  as  long  as  they 
comply  with  certain  restrictions,  such  as  attending 
treatment  programs  or  paying  fines,  fees,  and  restitution. 
The  stated  mission  of  the  Department  is  “to  serve  and 
protect  the  citizens  of  the  City  and  County  of  San  Francisco 
through  the  investigation  and  supervision  of  adult  criminal 
offenders.” 

The  Department  is  responsible  for  the  following  activities: 

• Producing  presentence  reports  to  assist  judges  in 
determining  sentences  for  adult  offenders. 

• Monitoring  the  behavior  of  adults  on  probation  and 
returning  them  to  Court  if  they  fail  to  fulfill  their 
probation  requirements. 

• Directing  offenders  to  treatment  programs  and 
counseling  services. 

• Ensuring  that  sex,  drug,  and  arson  offenders  register 
with  the  San  Francisco  Police  Department. 

• Warning  the  potential  victims  of  probationers. 

• Collecting  restitution  and  providing  information  and 
assistance  to  the  victims  of  crimes  as  well  as  collecting 
fines  and  fees  due  the  City  and  the  State. 
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The  Department  does  not 
supervise  probationers 
adequately 


As  of  February  2000,  the  Department  was  supervising 
approximately  10,400  probationers.  The  Department  had 
authorization  to  hire  127  full-time  equivalent  employees 
for  fiscal  year  1999-2000,  and  more  than  75  percent  of 
these  employees  were  probation  officers.  For  the  same 
year,  the  Department  had  a budget  of  $9.49  million.  The 
City  funds  the  Department,  but  the  Department  is 
responsible  to  the  Court,  which  appoints  the  chief  adult 
probation  officer.  The  current  chief  joined  the  Department 
in  August  1997,  replacing  the  former  chief,  who  retired 
after  1 8 years  in  the  position. 

Our  audit  revealed  that  although  its  primary  responsibility 
is  supervising  probationers,  the  Department  cannot  state  the 
exact  number  of  adult  criminal  offenders  it  is  supervising, 
nor  does  it  have  a system  to  ensure  that  its  supervision  of 
these  probationers  is  adequate.  As  a result,  some 
probationers  who  may  have  committed  serious  crimes  are 
not  complying  with  important  probation  requirements  and 
may  pose  a threat  to  the  public  and  create  liability  for  the 
City.  For  example,  we  reviewed  207  case  files  for 
probationers  and  found  that  of  the  76  probationers 
convicted  of  sex,  drug,  and  arson  offenses,  only  33  (43 
percent)  had  registered  with  the  police  department  even 
though  these  probationers  were  required  to  do  so. 
Consequently,  information  about  sex  offenders  may  not  be 
available  to  the  public  and  law  enforcement,  as  California's 
Megan's  Law  requires. 

Moreover,  we  found  that  of  38  open  probation  cases  the 
Department  had  assessed  as  “maximum  risk,”  probation 
officers  had  not  attended  to  1 8 (or  47  percent)  in  more  than 
30  days,  which  is  the  longest  time  between  contacts  the 
Department’s  policy  allows  for  such  cases.  Officers  had  not 
acted  on  8 of  the  cases  in  more  than  120  days,  thus  leaving 
potentially  dangerous  criminals  unsupervised  for  extended 
periods.  As  a 1999  court  case  in  the  State  of  Washington 
evidenced,  the  City  could  bear  legal  responsibility  for 
inadequate  supervision  of  probationers  by  the  Department. 

Weak  management  and  information  systems — many  of 
which  existed  prior  to  the  current  chiefs  arrival  in  1997 — 
have  led  to  the  inadequate  supervision  of  probationers  by 
the  Department.  Further,  over  60  percent  of  the 
Department’s  policies  and  procedures  are  more  than  10 
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years  old  and  no  longer  effectively  guide  its  activities. 


A recent  reorganization  of 
the  Department  may 
worsen  the  problem  of 
probationers  going 
unsupervised 


Poor  management  of 
collections  deprives 
victims , the  City,  and  the 
State  of  money  owed  them 


The  Department  relies  heavily  on  manual  processes  for 
tracking  its  probation  cases,  and  these  procedures  invite 
error.  However,  the  Department  has  several  automation 
initiatives  underway,  including  working  with  the  City’s 
Department  of  Telecommunications  and  Information 
Serv;  ‘S  to  obtain  a comprehensive,  automated  probation 
case  management  system  for  the  Department.  The  new 
system  could  help  the  Department  realize  significant 
efficiencies  as  well  as  improve  its  ability  to  manage,  track, 
and  measure  the  effects  of  its  probation  supervision 
activities. 

Although  a July  2000  reorganization  of  the  Department’s 
workload  may  improve  oversight  of  higher-risk  offenders, 
it  leaves  thousands  of  lower-risk  probationers  with  no 
supervision.  Senior  management  initiated  the  restructuring 
when  the  City  denied  the  Department’s  request  for 
additional  probation  officers.  Management  attributes  many 
of  the  gaps  in  probationer  supervision  to  the  Department’s 
heavy  workload  and  lack  of  resources.  However,  we  found 
that  the  Department’s  overall  staffing  is  comparable  to  that 
of  adult  probation  functions  in  other  jurisdictions. 

The  Department’s  reorganization  centers  around  a practice 
that  places  lower-risk  probationers  in  a large  “banked” 
caseload  and  leaves  probation  officers  with  more  time  to 
devote  to  higher-risk  cases,  an  approach  to  workload 
management  that  many  probation  agencies  follow.  Unlike 
other  probation  agencies,  however,  San  Francisco  Adult 
Probation  has  made  no  provision  to  monitor  probationers 
placed  in  the  banked  caseload.  Consequently,  the 
reorganization  will  allow  as  many  as  45  percent  of 
offenders  placed  on  probation  with  the  Department  to 
complete  their  sentences  without  complying  with  the  court- 
ordered  conditions  of  their  probation. 

In  addition  to  its  workload  and  supervision  difficulties,  the 
problem  of  assessing  and  collecting  financial  obligations 
from  probationers  is  an  issue  the  Department  has  been 
attempting  to  address.  Although  the  Department  recognizes 
collections  as  an  important  issue,  it  has  not  confronted  the 
problem  effectively.  As  a result,  there  have  been  significant 
lost  revenues  to  the  City,  the  State,  and  victims  of  crimes. 
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The  Department’s 
Investigations  Division 
produces  required  reports 
but  needs  to  improve  its 
data  collection  and 
documentation 


Our  audit  showed  that  46  percent  of  probationers  owing 
money  have  bad  addresses  and  thus  do  not  receive  bills. 
Bad  addresses  and  missing  information  in  the  Department’s 
accounting  system  could  be  costing  the  Department  more 
than  $360,000  per  year. 

Moreover,  75  percent  of  probationers  complete  their 
sentences  with  financial  obligations  unsatisfied;  many 
never  make  a single  payment.  As  of  December  1999,  $7.7 
million  was  past  due  on  open  probation  cases  because  the 
Department  makes  very  little  effort  to  collect  on  delinquent 
accounts.  The  Department  also  lacks  an  adequate  process  to 
determine  probationers’  ability  to  pay,  and  this  weakness 
results  in  a potentially  significant  amount  of  money  on  its 
books  that  it  cannot  reasonably  expect  to  collect. 
Consequently,  not  all  of  the  $7.7  million  outstanding  is 
collectable.  In  an  important  step,  the  Department  hired  a 
senior  collections  officer  in  June  2000;  however,  it  has  not 
taken  advantage  of  other  no-  and  low-cost  resources  that 
are  available  to  enhance  its  collections. 

Even  though  its  collections  function  has  weaknesses,  the 
Department  operates  effectively  in  other  areas.  Specifically, 
the  state-mandated  presentence  reports  that  the 
Department’s  Investigations  Division  (division)  produces 
to  guide  the  Court  in  its  sentencing  decisions  are  complete, 
and  the  division  generally  delivers  them  to  the  Court  in  a 
timely  manner.  In  fiscal  year  1998-99,  the  Court  requested 
approximately  3,800  reports  from  the  division,  and  a survey 
we  conducted  revealed  that  judges  are  satisfied  with  these 
reports.  Nevertheless,  the  number  of  continuances,  which 
require  rescheduling  the  sentencing  dates  for  offenders,  is 
rising.  Continuances  can  leave  in  the  community  for 
extended  periods  of  time  offenders  who  will  be  sentenced 
to  jail.  If  offenders  are  incarcerated  while  awaiting  their 
hearing,  these  changes  in  sentencing  schedules  can 
contribute  to  jail  overcrowding  by  leaving  offenders  in  jail 
longer  than  necessary.  Although  continuances  are  generally 
outside  the  division’s  control,  the  division  collects 
information  on  their  causes.  By  sharing  this  information 
with  the  Court  and  law  enforcement  agencies,  the  division 
could  help  identify  ways  of  keeping  the  number  of 
continuances  at  a minimum. 

We  based  our  conclusions  on  our  own  methodology 
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Planning  and  reporting 
processes  are  inadequate 
to  guide  the  Department’s 
operations 

because  the  division’s  statistics  for  total  reports,  late 
reports,  and  continuances  were  unreliable.  Without  accurate 
information  about  workload  and  performance,  the  division 
may  not  be  able  to  manage  its  resources  effectively  or 
identify  areas  of  opportunity  or  need.  Fortunately,  the 
division  plans  to  implement  an  enhanced  database  system 
that  will,  among  other  things,  provide  more  accurate 
statistics  about  the  division’s  activities. 

In  addition  to  relying  on  inaccurate  data,  the  Department 
does  not  have  a coherent  planning  process  and  it  is  not 
using  management  reports  to  direct  its  progress.  Although 
the  Department  has  an  ongoing  task  force  composed  of 
management  and  staff  which  has  been  examining  a number 
of  operational  areas  in  the  Department  and  has 
implemented  a number  of  changes,  the  task  force  is  not 
engaged  in  a long-term  strategic  planning  process.  For 
example,  neither  the  task  force  nor  senior  management  has 
communicated  a vision  of  the  future  to  the  staff  or  defined 
precisely  how  the  Department  is  to  serve  and  protect  the 
citizens  of  San  Francisco.  The  Department’s  goals  and 
objectives  lack  clarity,  and  its  performance  measures,  while 
improved  over  previous  years,  do  not  address  the 
effectiveness  or  outcomes  of  its  activities.  The  Department 
has  not  complied  with  a San  Francisco  Administrative 
Code  requirement  to  develop  a three-year,  forward-looking 
strategic  plan.  In  the  absence  of  such  guiding  principles  and 
the  policies  and  procedures  to  implement  them,  both 
management  and  staff  allow  day-to-day  demands  and  crises 
to  define  what  receives  attention. 

Further,  Department  management  does  not  appear  to  place 
much  value  on  data  or  detailed  reports  in  managing  its 
operations.  Senior  management  receives  few  reports  on 
department  activities,  and  the  chief  adult  probation  officer 
receives  no  regular  data  on  the  Department’s  primary 
responsibility,  which  is  supervising  probationers.  Without 
regular  reviews  of  data  showing  the  Department’s 
performance  in  various  areas,  the  Department  has  limited 
ability  to  make  timely,  well-informed  decisions  regarding 
its  activities.  The  Department  also  has  not  complied  with 
the  Administrative  Code  requirement  to  issue  an  annual 
report  on  its  operations,  thus  losing  an  important 
opportunity  to  report  its  accomplishments  to  the  City,  the 
Court,  the  public,  and  the  Department’s  own  staff. 

S-6 

CONTROLLER’S  AUDITS  DIVISION 

Lack  of  oversight  and 
weak  management 
controls  of  the  Department 
expose  the  City,  the 
Superior  Court,  and  the 
public  to  unnecessary  risk 


Key  Recommendations 


Not  only  is  oversight  of  departmental  activities  weak  within 
the  Department,  but  oversight  of  the  Department  by  outside 
authorities  is  also  lacking.  The  Court’s  oversight  of  the 
Department  is  minimal  and  consists  of  staff  contacts  and 
infrequent  brown  bag  lunches  at  which  the  judges  and  the 
chief  discuss  specific  issues.  Moreover,  the  City  lacks 
sufficient  authority  over  the  Department  to  give  it  effective 
guidance.  This  lack  of  management  controls  exposes  the 
City,  the  Court,  and  the  public  to  an  array  of  risks, 
including  inadequately  supervised  probationers  and  poor 
allocation  of  resources,  as  well  as  lost  revenues. 

Additionally,  the  Department’s  lack  of  comprehensive, 
current  policies  and  procedures  has  led  to  lost  revenue  and 
staff  time  and  has  increased  the  Department’s  chances  of 
ineffective  use  of  its  resources.  The  Department 
acknowledges  that  its  policies  and  procedures  are  deficient 
and  outdated.  In  fact,  as  of  June  2000,  most  were  more  than 
10  years  old.  Further,  inconsistent  use  of  employee 
performance  appraisals  weakens  accountability  of  staff. 

The  Court’s  minimal  oversight  of  the  Department  has 
allowed  the  Department  to  continue  its  operations  without 
addressing  risks  that  may  jeopardize  public  safety  and  the 
Department’s  success.  To  improve  the  Department’s 
accountability,  the  City  could,  under  state  law,  change  the 
way  the  chief  is  appointed  so  that  the  City  has  greater 
control  over  the  Department. 

The  Adult  Probation  Department  needs  to  be  accountable 
for  results  and  improve  its  operations,  so  the  Department, 
the  City,  and  the  Superior  Court  should  act  on  the 
recommendations  presented  in  this  report,  including  those 
outlined  below: 

To  provide  an  appropriate  level  of  supervision  to  all 
probationers  for  which  it  is  responsible,  the  Department 
should  take  these  steps: 

• Provide  some  measure  of  oversight  for  probationers 
that  are  part  of  the  Department’s  new  caseload  for 
lower-risk  offenders. 

• Develop  and  enforce  a system — such  as  periodic 
reviews  of  random  probation  case  files — to  ensure  that 
probation  officers  are  providing  adequate  supervision  to 
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their  probationers  and  that  probationers  are  complying 
with  the  conditions  of  their  probation. 

• Work  closely  with  the  Department  of 
Telecommunications  and  Information  Services  in 
procuring  and  implementing  an  automated  case 
management  system  for  the  Department. 

To  improve  probationers  * compliance  with  court  orders 
for  financial  obligations , the  Department  should  enhance 
its  collection  activities  the  following  ways: 

• Contract  with  the  state  Franchise  Tax  Board  or  another 
entity  to  collect  on  delinquent  probation  accounts. 

• Establish  controls  to  ensure  that  information  in  the 
accounting  system  is  complete  and  accurate. 

• Strengthen  its  process  for  assessing  a probationer’s 
ability  to  pay  and,  to  the  extent  law  allows,  require 
probation  officers  to  set  financial  obligations  at  a level 
the  offender  can  reasonably  pay. 

• Apply  to  the  State’s  Board  of  Control  for  funding  to 
support  an  additional  collection  position. 

To  operate  more  effectively,  the  Department  needs  to  take 
actions  to  improve  its  management  controls  and 
strengthen  its  process  for  strategically  planning  its  future: 

• Build  its  management  capacity  and  ability  to  implement 
key  department  initiatives,  including  improving  its 
collection  function  and  automating  its  case  management 
system,  by  retaining  a consultant,  filling  its  principal 
administrative  analyst  position,  or  employing  other 
means. 

• Implement  a strategic  planning  process  that  results  in  a 
comprehensive  set  of  goals  and  objectives  that  clearly 
defines  the  outcomes  that  the  City,  the  Court,  and  the 
Department  seek  and  the  steps  needed  to  achieve  those 
outcomes. 

• Develop  and  use  clearly  stated  performance  measures 
that  address  the  effectiveness  and  desired  outcomes  of 
the  Department’s  programs. 

• Monitor  and  report — internally  and  to  those  outside  the 
Department — departmental  accomplishments  in  terms 
of  its  established  performance  measures. 
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Superior  Court  Response 


Adult  Probation 
Department  Response 


To  hold  the  Department  and  the  chief  adult  probation 
officer  responsible  for  providing  adequate  supervision  to 
all  probationers: 

• The  Superior  Court  should  establish  a formal  system  of 
oversight  and  work  with  the  Department  to  prioritize 
and  address  the  deficiencies  this  report  identifies. 

• The  Department  should  develop,  under  the  Court’s 
supervision,  a management  improvement  plan  that 
includes  short  and  long  term  objectives,  specific  action 
steps,  and  regular  progress  reports  to  the  Court. 

• The  City  should,  after  one  year,  evaluate  the 
Department’s  progress  under  the  Court’s  oversight  and 
determine  whether  it  is  advisable  to  consider  a charter 
amendment  that  would  transfer  from  the  Court  to  the 
City  the  authority  to  appoint  the  chief. 

The  Court  acknowledges  that  there  are  problems  with  San 
Francisco’s  Adult  Probation  Department,  as  there  are  in 
many  other  counties.  However,  the  Court  recognizes  that 
the  Department  has  additional  problems  that  require  the 
Court  to  provide  greater  oversight  of  the  Department,  and 
the  Court  will  establish  a Judicial  Oversight  Committee  to 
formalize  this  oversight.  The  Court  also  feels  very  strongly 
that  it  retain  authority  to  appoint  the  chief  adult  probation 
officer. 

The  Department  agrees  with  many  of  the  report’s  key 
findings,  including  that  probationers  are  not  adequately 
supervised,  that  management  systems  and  oversight  are 
weak,  and  that  the  collection  of  fines  and  fees  could  be 
improved.  The  Department  describes  actions  it  has  initiated 
to  address  some  of  the  problems  the  report  identifies. 
However,  the  Department  provided  many  individual 
comments  disagreeing  with  specific  points  of  the  report. 

The  Department  took  particular  issue  with  the  report’s 
findings  regarding  the  Department’s  allocation  of  staff  and 
the  frequency  and  content  of  management  reports.  The 
Department  also  objected  to  some  of  the  specific  data  and 
methodologies  used  in  the  report. 

The  Controller’s  Audits  Division  addresses  the 
Department’s  comments  at  the  end  of  the  report. 
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INTRODUCTION 


Probation  is  one  sentencing  option  available  to  a court  in  the  State  of  California 

(State).  A sentence  of  probation  allows  the  person  convicted  of  a crime  to  remain  in 
the  community  as  long  as  he  or  she  complies  with  certain  restrictions,  which  may 
include  all  or  some  of  the  following:  reporting  regularly  to  a probation  officer,  submitting 
to  drug  testing,  attending  treatment  programs,  or  paying  fines,  fees,  and  restitution. 

Probation  differs  from  parole  in  that  it  is  an  alternative  to  incarceration,  whereas  parole  is 
the  conditional  release  of  an  offender  who  has  served  time  in  jail  or  prison.  Although 
various  offenses  can  result  in  sentences  of  probation,  typical  offenses  that  receive  this 
sentence  include  drunk  driving,  drug  violations,  and  domestic  violence.  The  California 
Penal  Code  (Penal  Code)  prohibits  sentences  of  probation  for  more  serious  crimes,  such  as 
those  involving  murder,  rape,  and  possession  or  sale  of  large  quantities  of  drugs.  (The 
glossary  on  the  following  page  lists  terms  that  this  report  uses  often.) 

The  California  Welfare  and  Institutions  Code  requires  that  each  county  in  the  State  have  a 
probation  department.  The  City  and  County  of  San  Francisco  (City)  has  two:  one  for  adult 
offenders,  another  for  juveniles.  The  Penal  Code  details  the  responsibilities  of  probation 
departments  and  states  that  the  county  probation  officer  shall  determine  the  level  and  type 
of  supervision  to  provide  probationers  within  the  court-ordered  conditions  of  probation. 

The  state  Superior  Court  for  the  County  of  San  Francisco  (Court)  is  the  judicial  entity  in 
the  City  that  sentences  adult  offenders  to  probation,  specifying  the  length  of  each  sentence 
and  the  conditions  to  which  the  probationer  must  adhere.  Those  sentenced  to  probation 
with  the  Adult  Probation  Department  (Department)  are  called  probationers  and  commonly 
serve  three-  to  five-year  probation  terms  under  the  supervision  of  probation  officers  from 
the  Department.  Each  probation  officer — a peace  officer  under  state  law — supervises 
multiple  probation  cases,  which  together  make  up  one  caseload.  As  an  alternative,  the 
Court  may  instead  sentence  offenders  to  probation  with  the  Court  (called  court  probation), 
a period  of  time  during  which  offenders  are  not  supervised  but  can  receive  the  maximum 
penalty  if  they  reoffend. 

The  stated  mission  of  the  Department  is  “to  serve  and  protect  the  citizens  of  the  City  and 
County  of  San  Francisco  through  the  investigation  and  supervision  of  adult  criminal 
offenders.”  The  Department  is  responsible  for  the  following  activities: 

• Producing  presentence  reports  to  assist  judges  in  determining  sentences  for  adult  offenders. 
• Monitoring  the  behavior  of  adults  on  probation  and  returning  them  to  Court  if  they  fail 
to  fulfill  their  probation  requirements. 

• Directing  offenders  to  treatment  programs  and  counseling  services. 

• Ensuring  that  sex,  drug,  and  arson  offenders  register  with  the  police  department. 

• Warning  the  probationer’s  potential  victims. 

• Collecting  restitution  and  providing  information  and  assistance  to  the  victims  of  crimes 
as  well  as  collecting  fines  and  fees  due  the  City  and  the  State. 
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Terms  That  Appear  Frequently  in  This  Report 

Case  —Probationer’s  record  or  file  containing  information  about  the  probationer,  reports, 
forms,  and  other  documentation. 

Caseload — Total  cases  supervised  by  an  individual  probation  officer.  This  term  may  also  refer  to 
all  cases  within  a specific  unit  or  the  total  cases  maintained  by  the  probation  department. 

Compliance — Fulfillment  by  offenders  of  the  terms  and  conditions  of  their  probation. 

Condition  of  probation — Provision  that  the  Court  orders  a probationer  to  obey,  such  as  receiving 
therapy,  registering  as  a sex  offender,  paying  a fee,  or  staying  away  from  his  or  her  victim(s). 

Court  probation — A sentencing  option  of  the  Court  that  allows  an  offender  to  remain  free  with 
fewer  restrictions  than  with  standard  probation  and  with  accountability  to  the  Court  rather  than  to 
a probation  officer. 

Felony — A crime  for  which  the  punishment  can  include  imprisonment  for  more  than  one  year. 
This  type  of  crime  is  more  serious  than  a misdemeanor. 

Misdemeanor — A crime  for  which  the  punishment  can  include  imprisonment  for  up  to  one  year. 
This  type  of  crime  is  less  serious  than  a felony. 

Probation — A sentencing  option  of  the  Court  that  allows  an  offender  to  remain  free  as  long  as  he 
or  she  complies  with  certain  conditions  and  remains  accountable  to  a probation  officer  for 
supervision. 

Probation  officer — A sworn  peace  officer  who  investigates,  reports  on,  and  supervises  the 
conduct  of  convicted  offenders  on  probation. 

Probationer — Somebody  who  is  on  probation,  especially  a criminal  offender  who  is  under  the 
supervision  of  a probation  officer. 

Revocation  of  probation — A rescinding  of  probation  by  the  Court,  usually  as  a result  of  the 
probationer’s  failure  to  comply  with  the  conditions  of  probation. 

Risk  assessment — 

1 . Testing  instrument  and  process  used  to  determine  a probationer’s  potential  risk  of 
noncompliance  with  conditions  of  probation. 

2.  Management  process  that  identifies  the  internal  and  external  challenges  that  an  organization 
must  address. 

Term  of  probation — Length  of  time  an  offender  is  accountable  to  the  probation  department. 

Termination  of  probation — Satisfactory  completion  by  an  offender  of  his  or  her  term  of 
probation. 
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Exhibit  1 The  Department’s  Role  Within  San  Francisco’s  Criminal  Justice  System 


As  of  February  2000,  the  Department  had  approximately  10,400  probationers  under  its 
supervision.  According  to  a division  director,  most  probationers  are  serving  sentences  for 
crimes  committed  in  the  City,  and  the  great  majority  of  probationers  live  in  the  City  or  in 
another  Bay  Area  county.  The  Department  also  provides  supervision  to  probationers  who 
committed  crimes  elsewhere  but  have  had  their  cases  transferred  to  the  Department 
because  these  offenders  live  in  San  Francisco. 

Exhibit  2 depicts  probation  outcomes  for  the 
Department’s  cases  from  1989  through  1998.  San 
Francisco’s  rates  for  offenders’  successful 
completion  of  probation  and  failure  to  complete 
the  terms  and  conditions  of  probation  are  similar 
to  the  rates  of  other  California  counties  during 
this  time  period.  Many  variables  influence 
probation  outcomes.  For  example,  a high  rate  of 
probation  completion  may  indicate  that 
probationers  received  supervision  and  programs 


Exhibit  2 

San  Francisco  Probation  Outcomes 
1989-1998 

Probation 
Revoked 
37% 

Probation 
Completed 
44% 


CONTROLLER’S  AUDITS  DIVISION 


3 


that  promoted  successful  outcomes.  However,  high  rates  of  probation  completion  could 
also  indicate  lax  supervision.  For  example,  probationers  who  finish  probation  sentences 
may  nonetheless  have  violated  the  conditions  of  their  probation  without  the  knowledge  of, 
or  action  by,  their  probation  officers. 

To  manage  the  probation  process,  San  Francisco’s  Adult  Probation  Department  has  three 
divisions.  The  Investigations  Division  examines  the  background  of  individuals  after  felony 
convictions,  but  before  the  sentencing  of  these  offenders,  and  it  prepares  reports  for  the 
Court  that  recommend  probation  or  another  type  of  sentence.  Two  divisions — the 
Community  Services  Specialized  Division  and  the  Community  Services  Outreach 
Division,  renamed  the  Community  Services  General  Supervision  Division  in  June  2000 — 
supervise  offenders  placed  on  probation  and  enforce  court  orders.  In  addition, 
administrative  staff  provide  support  services  to  the  Department  and  collect  restitution, 
fines,  and  fees  from  probationers. 

The  Department  is,  in  some  key  ways,  responsible  to  two  entities:  the  San  Francisco  Board 
of  Supervisors  (Board)  and  the  state  Superior  Court.  As  specified  in  the  City  and  County  of 
San  Francisco  Charter  (Charter),  the  Court  is  responsible  for  appointing  the  chief  adult 
probation  officer  (chief),  who  heads  the  Department.  The  current  chief  joined  the 
Department  in  August  1997,  replacing  the  former  chief,  who  retired  after  18  years  in  the 
position.  The  Charter  stipulates  that  the  Board  provides  the  chief  with  the  authority  to 
appoint  assistants,  deputies,  and  other  employees  of  the  Department.  This  report  addresses 
some  implications  of  the  fact  that  two  entities  oversee  the  Department’s  functions. 

Figures  available  from  May  2000  show  that  the  Department  had  approximately  127  full- 
time equivalent  employees.  Probation  officers,  which  include  the  chief,  filled  101  positions 
and  constituted  more  than  75  percent  of  the  total  staff.  Of  these,  62  probation  officers  had 
caseloads  and  directly  supervised  probationers.  The  remaining  probation  officers  worked 
either  in  the  Investigations  Division  or  filled  administrative  or  management  positions. 

The  Department’s  total  budget  for  fiscal  year  1999-2000  was  $9.49  million.  Exhibit  3 on 
the  following  page  depicts  the  sources  of  funding  and  their  share  of  the  total  budget.  The 
City’s  budgeted  general  fund  contribution  was  $7.7  million.  Approximately  $1.4  million  in 
federal  and  state  grants  support  special  programs  for  women  and  drug  offenders  and 
provide  training  funds.  Approximately  $400,000  in  court-ordered  fees  paid  by  probationers 
makes  up  most  of  the  remainder  of  the  Department’s  budget.  As  Exhibit  4 shows,  the 
Department  spends  almost  half  of  its  budget,  $4.4  million,  on  the  supervision  of 
probationers. 
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Exhibit  3 

Sources  of  Funds 
Fiscal  Year  1999-2000 


Exhibit  4 
Uses  of  Funds 
Fiscal  Year  1999-2000 


City 

General 

Fund 


Federal 

Grants 

14% 


Supervision  of 
Probationers 
46% 


Administration 
s,  33% 


81% 


Probationer 

Fees 

4% 


- Grants 


Investigations 

21% 


1% 


SCOPE  AND  METHODOLOGY 

The  purpose  of  this  audit  was  to  assess  the  overall  performance  of  the  Department  and  to 
identify  areas  for  improvement.  We  evaluated  the  Department’s  management  controls — 
that  is,  the  tools  it  uses  to  operate  and  to  supervise  probationers,  including  its  strategic 
planning,  policies  and  procedures,  and  performance  measurements — to  ensure  it  is 
achieving  its  objectives.  We  also  conducted  a financial  controls  review  of  the  cashier’s 
office  at  the  Department. 

We  reviewed  the  performance  of  each  of  the  Department’s  principal  functions:  the 
management  of  probation  cases  by  the  two  Community  Services  divisions,  the  collection 
of  fines  and  fees  from  probationers  by  the  cashier’s  office,  and  the  presentence 
investigation  of  felony  offenders,  which  is  performed  by  the  Department’s  Investigations 
Division.  To  accomplish  this  review,  we  conducted  interviews  of  staff  and  management; 
analyzed  workload,  performance,  and  other  data  from  the  Department  and  other 
jurisdictions;  and  conducted  surveys  of  staff,  judges,  and  other  probation  departments. 

To  gauge  the  effectiveness  of  the  Department’s  case  management  system,  we  analyzed  the 
process  by  which  the  Department  keeps  track  of  its  open  cases  and  examined  the  accuracy 
of  its  caseload  data.  We  randomly  requested  225  case  files  to  determine  whether  they 
contained  all  required  documents  and  to  see  whether  probation  officers  followed  the 
Department’s  procedures  regarding  the  supervision  of  probationers.  Further,  we  evaluated 
the  data  from  adult  probation  departments  in  other  California  counties  with  similar 
population  sizes  as  San  Francisco  so  that  we  could  compare  caseload  and  probation 
outcome  statistics.  Lastly,  we  conducted  a written  survey  of  probation  departments  in 
California  and  in  other  states  to  see  if  other  departments  employ  practices  that  the 
Department  might  benefit  from  using. 

Our  review  of  the  Department’s  Investigations  Division  included  analysis  of  its  data 
collection  and  reporting.  We  assessed  whether  presentence  reports,  the  principal  report 
prepared  by  the  division,  meet  criteria  set  out  by  the  Penal  Code.  We  also  conducted  a 
survey  of  criminal  court  judges  to  determine  the  level  of  their  satisfaction  with  the  reports 
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they  are  receiving  from  the  division  and  to  obtain  their  suggestions  for  changes  or 
improvements. 

In  assessing  the  Department’s  performance  regarding  collection  of  fines,  fees,  and 
restitution  from  probationers,  we  reviewed  state  and  local  laws  and  the  Department’s  own 
processes  and  procedures,  researched  collection  options,  and  obtained  various  data  from 
the  Department’s  accounting  system.  We  analyzed  data  detailing  current  billing  and 
payment  information  on  open  probation  cases  for  each  month  from  June  through  December 
1999.  To  assess  trends  in  court-ordered  fines  and  fees,  we  obtained  information  about  all 
cases  directed  to  pay  fines  and  fees  from  July  1,  1995,  through  June  30,  1999.  We  also 
received  data  on  the  Department’s  annual  collections  for  fiscal  years  1995-96  through 
1998-99. 

In  addition,  we  evaluated  the  Department’s  management  process  for  strategic  planning  and 
performance  measurement.  We  reviewed  recent  budgets,  the  most  recent  annual  report,  and 
other  documents  to  assess  the  adequacy  of  the  Department’s  mission,  goals,  objectives, 
performance  measures,  and  management  reports.  As  part  of  our  work  in  this  area,  we 
assisted  the  Department  in  refining  the  performance  measures  in  its  fiscal  year  2000-01 
budget  submission  and  suggested  additional  measures  for  it  to  consider  including  in  future 
budgets. 

To  obtain  input  from  Department  staff  on  various  issues,  such  as  departmental 
management,  job  satisfaction,  workload,  and  training,  we  conducted  a confidential  survey 
of  all  staff,  including  senior  management.  The  survey  asked  both  closed-  and  open-ended 
questions  to  elicit  employee  attitudes  and  opinions  about  working  for  the  Department  and 
about  working  with  probation  clients  as  well  as  to  solicit  ideas  or  suggestions  the 
employees  may  have  for  improving  the  Department.  We  presented  the  results  of  the  survey 
to  all  staff  as  well  as  to  the  presiding  judge  of  the  Court. 
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CHAPTER  1 

THE  DEPARTMENT  DOES  NOT  SUPERVISE 
PROBATIONERS  ADEQUATELY 


CHAPTER  SUMMARY 

The  Adult  Probation  Department  (Department)  of  the  City  and  County  of  San 

Francisco  (City)  cannot  state  the  exact  number  of  adult  criminal  offenders  under  its 
supervision,  nor  does  it  have  a system  to  ensure  that  it  is  providing  adequate 
oversight  to  these  probationers.  As  a result,  some  probationers  who  committed  serious 
crimes  are  not  complying  with  important  probation  requirements  and  could  pose  a potential 
danger  to  the  community  and  a liability  to  the  City.  Although  the  Department  recognizes 
most  of  the  problems  this  report  identifies — many  of  which  existed  prior  to  the  arrival  of 
the  current  chief  adult  probation  officer  (chief)  in  August  1997 — and  has  initiated  efforts  to 
address  some  of  them,  certain  key  issues,  including  the  supervision  of  probationers,  have 
not  received  appropriate  attention. 

During  our  audit,  we  reviewed  207  probation  case  files  and  subsequently  checked  relevant 
police  records.  Of  the  probationers  represented  by  these  case  files  and  convicted  of  sex, 
drug,  and  arson  offenses,  only  43  percent  registered  with  the  San  Francisco  Police 
Department  even  though  they  were  required  to  do  so.  Consequently,  information  about  sex 
offenders  may  not  be  available  to  the  public,  as  California's  Megan's  Law  requires,  or  to 
law  enforcement  officials,  who  need  current  information  about  all  offenders  required  to 
register.  Moreover,  probation  officers  had  not  attended  to  47  percent  of  the  38  open 
probation  cases  we  reviewed  that  the  Department  had  assessed  as  “maximum  risk”  in  more 
than  30  days,  which  is  the  longest  time  between  contacts  the  Department’s  policy  allows 
for  such  cases.  Eight  of  the  cases  had  had  no  action  in  more  than  120  days.  Management’s 
failure  to  enforce  the  Department’s  contact  requirements  for  maximum-risk  probationers 
results  in  potentially  dangerous  criminals  remaining  unsupervised  for  extended  periods. 

Department  managers  attribute  many  of  the  gaps  in  probationer  supervision  to  the 
Department’s  heavy  workload  and  lack  of  resources.  With  the  Department’s  staffing  and 
workload  configuration  at  the  time  of  the  audit,  seven  probation  caseloads,  containing 
more  than  1,500  probationers,  were  going  unsupervised.  However,  we  found  that  the 
Department’s  overall  staffing  is  comparable  to  that  of  similar  adult  probation  functions  in 
other  jurisdictions.  In  July  2000,  senior  management  reorganized  the  Department  to 
address  workload  issues.  Although  the  reorganization  may  improve  the  oversight  of 
higher-risk  offenders,  it  leaves  thousands  of  lower-risk  probationers  with  no  supervision. 

In  its  efforts  to  manage  its  workload,  the  Department  relies  heavily  on  manual  processes 
for  tracking  its  probation  cases  and  does  not  fully  use  automated  information  systems. 
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Taking  a cue  from  probation  departments  in  other  counties,  San  Francisco’s  Adult 
Probation  Departi  nt  needs  to  replace  its  current  manual  and  automated  information 
systems  with  a single  automated  system  that  will  allow  probation  officers  to  spend  more 
time  meeting  with  probationers  and  less  time  completing  paperwork. 


BACKGROUND 

The  Department’s  system  for  monitoring  probationers  is  almost  completely  manual.  Paper 
case  files  are  the  Department’s  primary  source  of  documentation  regarding  probationers. 
Case  files  contain  information  about  court-ordered  probation  conditions,  probationer 
compliance  with  those  conditions,  and  probation  officer  actions.  They  also  include  specific 
personal,  educational,  employment,  relationship,  conduct,  and  criminal  history  information 
about  the  probationer.  Probation  officers  keep  case  files  for  open  probation  cases  in  their 
offices.  Each  month  probation  officers  report  to  their  managers  information  about  the 
number  of  cases  they  are  supervising,  and  the  managers  compile  statistics  for  the 
Department.  The  Department,  as  required  by  state  law,  submits  monthly  data  on  its  number 
of  cases  to  the  California  Department  of  Justice,  which  publishes  the  information  for  all 
California  counties. 

Each  month,  the  Department  receives  an  average  of  about  500  cases,  which  it  adds  to  its 
total  of  about  10,400,  and  closes  or  transfers  out  approximately  the  same  number.  The 
Department’s  policy  is  to  evaluate  each  new  probationer  to  determine  the  level  and  type  of 
supervision  warranted.  It  then  assigns  him  or  her  to  one  of  the  more  than  60  probation 
officer  caseloads,  which  are  defined  by  levels  of  risk  or  special  needs.  Probation  officers 
who  supervise  probationers  (as  opposed  to  probation  officers  assigned  to  investigations  or 
administration)  are  each  responsible  for  one  caseload. 

Probation  officers  supervise  their  cases  according  to  the  level  of  risk  the  probationers  pose 
to  the  public.  Maximum-risk  caseloads  include  cases  that  require  the  closest  supervision 
and  the  most  frequent  face-to-face  contact.  Probationers  assessed  as  medium  or  minimum 
risk  under  the  system  in  place  through  June  2000  were  considered  to  pose  less  threat  to  the 
public  than  maximum  risk  cases  and  were  not  required  to  report  as  often  to  their  probation 
officers. 

In  July  2000,  the  Department  implemented  a new  system  of  “banking”  those  cases  it  deems 
lower  risk  in  order  to  focus  supervision  on  maximum-risk  probationers.  The  banked 
caseload  is  intended  to  consist  primarily  of  offenders  assessed  as  minimum  or  medium 
risk.  Probationers  in  the  banked  caseload  will  receive  no  supervision  and  will  not  be 
required  to  report  to  the  Department.  The  Department  also  has  special  caseloads  that 
provide  targeted  assistance  to  probationers  with  specific  needs,  such  as  those  convicted  of 
domestic  violence,  drunk  driving,  and  gang-related  offenses  or  those  with  mental  health 
issues.  Many  of  these  probationers  are  considered  maximum  risk. 
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The  Department  manages  its  caseloads  under  two  divisions — the  Community  Services 
Specialized  Division  and  the  Community  Services  Outreach  Division,  renamed  the 
Community  Services  General  Supervision  Division  in  June  2000.  At  the  time  of  the  audit, 
most  of  the  Department’s  69  caseloads  ranged  in  size  from  35  to  350  probation  cases,  with 
higher-risk  probationers  making  up  the  smaller  caseloads.  Several  caseloads  contained 
low-risk  probationers  and  were  quite  large,  with  as  many  as  600  cases.  The  Department’s 
July  2000  restructuring  reduced  the  number  of  caseloads  to  63  and  limited  the  size  of  most 
of  the  caseloads  to  100  or  fewer  probation  cases.  The  new  banked  caseload  could  contain 
4,700  probationers,  according  to  Department  estimates. 

To  assess  file  management  and  evaluate  certain  aspects  of  the  Department’s  supervision  of 
probationers,  we  conducted  a review  of  open  and  closed  probation  case  files.  We  requested 
the  files  of  a random  sample  of  225  cases  ordered  to  probation  between  July  1995  and 
December  1999.  Of  the  225  cases,  10  were  unusable  because  the  files  duplicated  listings, 
contained  minimal  paperwork  because  the  offenses  were  new,  or  had  been  purged 
according  to  policy.  The  Department  could  not  provide  files  for  8 of  the  cases,  leaving  207 
case  files  for  review. 

To  compare  the  Department’s  workload  and  operations  to  the  adult  probation  functions  in 
other  jurisdictions,  we  conducted  a survey  of  counties  within  California  and  in  other  states 
and  also  reviewed  10  years  of  data  on  adult  probation  cases  in  the  City  and  12  other 
California  counties. 


THE  DEPARTMENT  DOES  NOT  KNOW 
EXACTLY  HOW  MANY  PROBATIONERS 
ARE  UNDER  ITS  SUPERVISION 

The  Department  cannot  provide  the  exact  number  of  probationers  it  supervises,  and  its 
reporting  process  is  flawed.  These  weaknesses  call  into  question  its  ability  to  track, 
oversee,  and  hold  probationers  accountable  for  fulfilling  the  conditions  of  probation. 
Inaccurate  case  counts  limit  the  ability  of  the  Department  and  the  City  to  allocate  resources 
in  the  most  effective  manner.  In  addition,  if  flaws  in  the  way  the  Department  gathers  and 
reports  data  continue,  it  could  lead  researchers,  legislators,  the  media,  and  the  public  to 
draw  inappropriate  conclusions  regarding  crime  patterns,  probation  outcomes,  and  the 
effectiveness  of  the  criminal  justice  system. 

The  Department  tracks  its  case  count  by  requiring  probation  officers  to  report  the  number 
of  probation  cases  under  their  supervision  each  month.  Our  findings  lead  us  to  believe  that 
the  Department’s  caseload  reporting  process  is  faulty  and  that  the  caseload  data  are  inexact. 
However,  for  lack  of  an  alternative,  and  because  we  needed  some  method  of  assessing  and 
comparing  the  Department’s  workload  and  performance,  we  assumed  in  this  report  that  the 
Department’s  reported  caseload  figures  provide  a reasonable  approximation  of  the  true 
caseload  size. 
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The  Department's  Process  for  Reporting 
Caseload  Data  Is  Prone  to  Error 

Unit  supervisors  do  not  always  verify  the  accuracy  of  the  figures  the  probation  officers 
report.  The  lack  of  oversight  creates  opportunities  for  several  types  of  inaccuracies  to  go 
undetected.  Besides  clerical  and  other  sorts  of  unintentional  errors,  probation  officers  could 
get  into  the  habit  of  making  estimates  each  month  rather  than  reporting  exact  numbers.  In 
addition,  the  possibility  exists  that  an  officer  could  overstate  his  or  her  case  count  in  an 
effort  to  receive  fewer  new  cases. 

Even  with  improved  oversight,  the  Department’s  reporting  process  has  weaknesses  that 
make  the  case  count  prone  to  error.  The  process  requires  that  once  a month  probation 
officers  record  on  a paper  form  the  number  and  other  characteristics  of  their  cases.  Unit 
supervisors  then  enter  the  data  into  a computerized  spreadsheet,  a process  that  not  only 
duplicates  labor  unnecessarily  but  also  doubles  the  potential  for  errors. 

Furthermore,  the  Department  calculates  its  total  monthly  caseload  figure  by  adding  new 
cases  and  subtracting  closed  or  transferred  cases  from  the  previous  month’s  total.  Using  the 
same  baseline  figure  each  month  perpetuates  errors  over  time.  The  Department  could 
mitigate  the  risk  inherent  in  this  method  by  conducting  periodic  counts  of  cases  to  ensure 
the  accuracy  of  the  baseline.  However,  despite  discrepancies  identified  as  the  result  of  a 
limited  count  in  1997  (which  the  next  section  describes),  the  Department  has  no  policy  or 
practice  of  regular  recounts.  The  Department  does  not  consider  it  a priority  to  gather  and 
report  accurate  caseload  data. 

Because  the  processes  for  reporting  and  recording  case  counts  are  prone  to  error,  and 
because  errors  are  carried  over  from  the  previous  month,  the  Department  may  be  providing 
inaccurate  caseload  data  to  the  City  and  to  the  California  Department  of  Justice.  More 
importantly,  these  inaccuracies  suggest  that  some  probationers  are  not  receiving  the 
supervision  that  the  law  requires. 

Evidence  Indicates  That  Probationers 
May  Be  Going  Unsupervised 

The  audit  did  not  come  across  any  instances  of  harm  to  persons  or  property  by  probationers 
who  lacked  appropriate  supervision.  However,  we  did  find  evidence  of  probation  cases 
unaccounted  for  by  their  probation  officers  as  well  as  probation  files  that  the  Department 
could  not  locate,  and  these  findings  indicate  that  some  probationers  may  be  going 
unsupervised. 

In  1997,  one  of  the  two  community  services  divisions  conducted  a count  of  its  probation 
cases,  which  revealed  that  some  probation  officers  did  not  know  how  many  cases  they 
were  supervising.  A unit  supervisor  stated  that  because  of  the  count,  several  of  her  officers 
discovered  they  had  many  more  cases  than  they  previously  realized.  One  officer  had  68 
additional  cases  while  another  had  approximately  1 00  more  cases  than  the  officer  knew 
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about.  The  supervisor  did  not  say  that  the  probation  officers  were  not  supervising  those 
additional  cases,  but  such  large  discrepancies  between  the  number  of  cases  officers  think 
they  have  and  how  many  they  actually  have  lead  us  to  believe  that  at  least  some 
probationers  are  going  unsupervised. 

Our  review  of  a sample  of  probationer  case  files  further  supports  this  conclusion.  The 
Department  was  unable  to  provide  us  with  five  open  case  files  we  requested.  Although  they 
represent  a small  percentage  of  the  total  files  we  asked  for,  these  files  include  paperwork 
for  five  probationers  whom  judges  kept  out  of  jail  on  the  condition  that  the  Department 
supervise  them.  If  the  Department  cannot  find  their  files,  the  Department  cannot  determine 
whether  the  probationers  are  fulfilling  the  conditions  of  their  probation. 

According  to  several  staff  members,  misplaced  case  files  are  not  uncommon.  Typically, 
when  a probation  officer  or  other  staff  member  cannot  find  a file,  he  or  she  will  declare  the 
file  lost  and  create  a new  one.  The  Department  recognizes  the  problems  associated  with 
this  approach  and  is  in  the  process  of  improving  the  way  it  handles  case  files  by  replacing 
file  cabinets,  boxes,  and  offsite  storage  with  an  in-house,  automated  file  storage  and 
retrieval  system.  The  new  system  will  help  make  files  more  accessible  and,  to  the  extent 
that  staff  members  follow  the  rules  for  the  system’s  use,  limit  misplaced  files  by  tracking 
their  movement  and,  thus,  minimize  the  creation  of  duplicate  case  files.  The  new  file 
system,  however,  will  not  be  capable  of  providing  the  Department  with  data  about  caseload 
size  or  probationer  compliance  with  conditions  of  probation. 

The  Spreadsheet  the  Department  Uses  to 

Calculate  Caseload  Totals  Gives 

Conflicting  Results 

In  addition  to  the  reporting  errors  that  corrupt  case  count  data,  the  Excel  spreadsheet  the 
Department  uses  to  tabulate  open  cases  produces  conflicting  results.  Two  sums  that  should 
equal  each  other  do  not.  The  total  of  all  probationers  by  division  and  the  total  of  all 
misdemeanor  and  felony  probationers  should  be  identical;  each  total  should  represent  the 
total  number  of  cases  the  Department  supervises.  In  every  month  from  July  1 999  through 
February  2000,  however,  the  total  number  of  probationers  by  division  exceeded  by 
between  153  and  255  cases  the  total  for  the  misdemeanor  and  felony  probationers 
representing,  on  average,  2.2  % of  its  cases  each  month.  While  we  cannot  conclude  that  the 
Department  failed  to  provide  adequate  supervision  to  all  these  probationers,  the 
Department’s  inability  to  keep  better  track  of  its  cases  has,  at  least,  exposed  it  to  the  risk  of 
failing  to  provide  appropriate  supervision. 

While  aware  of  the  discrepancy,  neither  the  division  director  wfro  compiles  the  statistics 
nor  the  spreadsheet  creator,  a programmer  at  the  Department  of  Telecommunications  and 
Information  Services,  has  determined  the  source  of  the  problem.  The  division  director 
downplayed  the  importance  of  reconciling  the  conflicting  totals,  stating  that  a difference  of 
a few  hundred  cases  is  unimportant  because  probation  officers  know  the  cases  for  which 
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they  are  responsible.  However,  as  we  highlighted  above,  probation  officers  do  not  always 
know  about  all  cases  assigned  to  them. 

The  Department  does  not  know  if  either  total  is  correct.  Neither  total  may  be  an  accurate 
count  of  the  number  of  cases  the  Department  oversees.  The  Department  submits  the  felony 
and  misdemeanor  total  to  the  state  Department  of  Justice  and,  therefore,  may  not  be 
complying  with  the  California  Penal  Code  requirement  for  accurate  reporting. 


WEAKNESSES  IN  OVERSIGHT  AND  IN  POLICIES 
AND  PROCEDURES  CONTRIBUTE  TO 
INADEQUATE  SUPERVISION  OF  PROBATIONERS 


In  our  review  of  the  207  probation  case  files,  we  found  further  evidence  that  the 
Department  is  not  adequately  supervising  some  of  its  probationers.  Probation  officers  are 
not  meeting  with  their  probationers  as  frequently  as  the  Department  requires  and  are  not 
verifying  probationer  compliance  with  important  conditions  of  probation,  including  the 
registration  of  sex,  drug,  and  arson  offenders.  Probation  officers  are  responsible  for 
ensuring  that  probationers  comply  with  court-ordered  conditions  of  probation,  including 
registration  requirements.  The  Department,  however,  is  not  systematically  monitoring 
whether  probation  officers  are  meeting  this  responsibility.  We  also  found  that  lack  of 
comprehensive,  up-to-date  policies  and  procedures  frustrates  staff  and  managers,  hampers 
efficiency  and  effectiveness,  and  leads  to  inconsistencies  in  probationer  supervision. 

Many  of  these  and  other  problems  the  audit  identifies  originated  under  the  previous  chief 
adult  probation  officer  (chief),  who  retired  in  July  1 997  after  1 8 years  in  the  position.  The 
current  chief  has  initiated  efforts  to  address  some  problem  areas;  however,  certain  key 
issues,  including  the  adequate  supervision  of  probationers,  have  not  received  the  attention 
they  warrant. 


Probation  Officers  May  Not  Have 
Contact  With  Probationers  as  Frequently 
as  Required 

Probation  officers  may  not  be  seeing  some  of 
the  most  serious  offenders  as  frequently  as 
they  should.  Department  policy,  established 
under  the  previous  chief,  requires  that 
maximum-risk  probationers  have  at  least  one 
face-to-face  contact  with  their  probation 
officers  each  month.  As  Exhibit  5 illustrates, 
we  found  that  of  the  38  open,  maximum-risk 
cases  we  reviewed,  47  percent  (18  cases)  had 
no  evidence  of  case  action  of  any  kind  in  the 
last  30  days.  Of  these,  21  percent  (8  cases) 


Exhibit5 

Number  of  Days  Since  Last 
Recorded  Case  Action 
(38  maximum-risk  cases) 


Note:  Percentages  do  not  total  100%  due  to  rounding. 
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had  no  evidence  of  contact  with  their  probation  officers  for  more  than  120  days,  and  one 
case  had  no  action  at  all  recorded. 

Regular  contact  with  a probationer  allows  a probation  officer  to  verily  compliance  with 
probation  conditions  and  to  monitor  changes  in  the  probationer’s  situation.  If  a probationer 
is  not  complying  or  poses  some  other  threat  to  public  safety,  the  probation  officer  can  take 
action  promptly.  Management’s  apparent  lack  of  enforcement  of  the  Department’s  contact 
requirements  for  maximum-risk  probationers  means  that  potentially  dangerous  criminals 
are  remaining  unsupervised  for  extended  periods. 

The  Department  Has  Failed  to  Verify  That 

Probationers  Have  Met  Registration  and 

Enrollment  Requirements 

Although  the  State  of  California  Superior  Court  for  the  County  of  San  Francisco  (Court) 
has  ordered  many  probationers  to  register  with  the  San  Francisco  Police  Department  or  to 
enroll  in  treatment  programs,  the  Department  does  not  monitor  consistently  whether 
probationers  are  fulfilling  these  orders.  Specifically,  state  law  requires  persons  who 
commit  certain  sex,  drug,  and  arson  offenses  to  register  with  their  local  police  departments 
as  a condition  of  probation;  however,  the  Department  has  not  always  ensured  that 
probationers  have  done  so.  Exhibit  6 shows  that  of  the  207  probation  case  files  we 
reviewed,  76  included  registration  requirements. 

However,  police  records  revealed  that  only  33 
(43  percent)  of  these  probationers  had  actually 
registered.  Under  California’s  1996  Megan’s 
Law,  certain  information  on  the  residence  of 
dangerous  sex  offenders  must  be  available  to  the 
public.  The  Department’s  failure  to  ensure  that 
sex,  drug,  or  arson  offenders  register  creates  a 
risk  to  the  community  and  denies  accurate 
information  to  criminal  justice  agencies. 

Some  probation  officers  obtain  written  verification  of  registration  from  their  probationers; 
others  review  registration  status  on-line  via  the  City’s  Court  Management  System  database. 
However,  many  probation  officers  do  not  verify  registration.  In  our  case  file  review,  we 
found  evidence  of  registration  in  only  20  of  the  76  case  files  with  registration  requirements. 
Although  13  probationers  without  proof  of  registration  in  their  files  did  indeed  register, 
many  did  not,  and  these  omissions  indicate  a connection  between  the  Department’s  spotty 
verification  efforts  and  lack  of  probationer  compliance. 

Court-ordered  enrollment  in  certain  programs  or  assignment  to  treatment  can  be  another 
condition  of  probation.  For  example,  probationers  convicted  of  domestic  violence  offenses 
must  enroll  in  a program  and  undergo  counseling.  In  our  case  file  review,  we  identified  100 
probationers  who  should  have  enrolled  in  some  type  of  treatment  program.  However,  24  of 
the  files  did  not  contain  any  documentation  of  the  probationers’  enrolling  in  or  attending 


Exhibit  6 Registration  Status  of  76 
Probationers  Ordered  by  the  Court 
to  Register  With  the  SFPD 
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such  programs,  which  may  indicate  noncompliance.  The  Department’s  apparent  failure  to 
ensure  that  probationers  enroll  in  required  programs  or  obtain  treatment  may  put  the  public 
at  risk  when  these  offenders  complete  their  sentences  without  having  received  the 
counseling  or  program  benefits  ordered.  Officers  should  be  meticulous  in  documenting 
compliance. 

The  Department  Lacks  a System  to 

Monitor  Supervision  of  Probationers  by 

Probation  Officers 

Lack  of  systematic  oversight  by  department  management  allows  probation  officers  to  use 
their  discretion  to  supervise  or  not  to  supervise  probationers  and  to  work  according  to  their 
own  criteria.  A 17-year-old  policy — the  most  current  in  existence — requires  each 
supervisor  to  review  semiannually  15  randomly  selected  cases  for  each  probation  officer  in 
his  or  her  unit.  However,  we  found  no  evidence  that  supervisors  systematically  reviewed 
probation  officers’  work.  Three  officers  interviewed  indicated  they  had  not  had  a case 
review  since  they  were  new  employees  and  all  are  experienced  officers.  One  supervisor 
admitted  she  was  “behind”  in  her  case  reviews  and  misstated  the  policy  requirement. 
Another  said  he  was  unaware  of  a case  review  policy,  and  that  if  there  was  one,  it  was  not 
enforced  and  that  case  reviews  varied  from  supervisor  to  supervisor.  The  Department’s 
lack  of  a systematic  review  process  increases  the  chance  of  cases  being  lost  or  simply 
going  unsupervised. 

Case  reviews  take  time  and  effort.  Consequently,  supervisors  are  unlikely  to  undertake 
them  without  an  impetus  to  do  so.  By  not  enforcing  the  policy  requiring  reviews,  the 
Department’s  senior  management  has  failed  to  create  such  an  impetus.  Even  if  it  did,  the 
policy’s  lack  of  specificity  limits  its  effectiveness.  Although  the  Department  has  a set  of 
minimum  standards  for  managing  cases,  the  policy  does  not  refer  to  the  standards  or 
provide  other  criteria  to  use  in  reviewing  case  files.  There  are  also  no  guidelines  about 
documenting  the  reviews  or  taking  corrective  action  for  substandard  performance  by 
probation  officers. 

Because  the  Department  has  no  means  to  monitor  probationer  compliance  with  probation 
conditions,  case  reviews  by  supervisors  are  a critical  element  of  probation  officer 
oversight.  Examination  of  cases  selected  at  random  can  provide  supervisors  and  the 
Department  reasonable  assurance  that  all  probationers  are  receiving  adequate  supervision. 
As  Chapter  5 explains,  inadequate  supervision  of  probationers  by  the  Department  could 
expose  the  City  to  legal  liability. 

Periodic  case  reviews  also  would  allow  supervisors  to  track  the  progress  of  probation 
officers  as  well  as  the  officers’  compliance  with  policies  and  procedures,  to  verify 
completeness  of  paperwork  and  correctness  of  information,  and  to  document  performance 
of  the  officers.  Additionally,  case  reviews  could  help  the  Department  address  a concern 
highlighted  by  staff  in  our  survey  of  employees:  the  need  for  established  and  consistent 
policies  and  procedures  and  the  clear  communication  of  Departmental  priorities  to  staff. 
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The  Department  Does  Not  Have  Clear 
Policies  or  Standards  for  Maintaining 
Case  Files 

The  Department’s  lack  of  clear  policies  regarding  case  file  maintenance,  particularly  with 
respect  to  case  narratives,  hampers  its  supervision  of  probationers.  Without  clear  policies, 
documentation  in  case  files  is  inconsistent,  and  the  Department  is  unable  to  monitor 
probationers’  compliance  with  conditions  of  probation. 

State  law  charges  the  probation  officer  with  keeping  a complete  and  accurate  record  of 
each  probationer’s  case.  The  officer  is  to  use  the  case  narrative  to  record  certain  data,  such 
as  contacts  between  the  probation  officer  and  probationer,  probationer  statements,  changes 
in  residence,  probation  status,  and  probationer  employment  as  well  as  contacts  between  the 
probationer  and  related  agencies  or  entities.  Based  on  our  review  of  207  probation  case 
files,  no  other  document  in  the  case  file  or  in  probation  officer  records  chronicles  this 
information.  The  narrative  is  a critical  document  for  historical  perspective,  for  tracking  the 
probationer’s  compliance,  for  supervisory  review  of  the  probation  officer,  and  for  serving 
as  evidence  in  court  should  such  information  be  required. 

Missing  information  in  a case  file  indicates  possible  risk  to  the  community  and  potential 
violations  of  court-ordered  conditions.  The  probation  officer  may  not  be  tracking  the 
offender’s  compliance  with  terms  and  conditions  of  probation,  such  as  drug  and  chemical 
testing,  restitution  and  fee  payments,  or  community  service.  Each  case  file  should  include 
such  necessary  information  as  a probationer’s  new  job,  address,  or  phone  number.  If  files 
omit  such  data,  a new  probation  officer  who  receives  a transferred  file  may  not  have  access 
to  current  information  on  the  probationer.  Further,  when  the  District  Attorney’s  Office 
prosecutes  a probationer  for  a new  crime,  the  Department  may  not  be  able  to  report  fully  to 
the  Court  about  the  probationer’s  compliance  under  the  existing  sentence  of  probation.  The 
Court  may  not  receive  accurate  information,  and  inaccuracies  may  affect  the  severity  of 
new  sentencing  or  additional  probation  orders.  In  addition,  cooperating  agencies  may  not 
receive  current  data  in  response  to  requests  for  information. 

The  Department  has  no  policy  delineating  what  constitutes  a complete  case  record.  There  is 
only  a procedure  for  the  order  of  filing  documents  that  the  case  file  should  include.  A 
management  subcommittee  initiated  discussion  of  the  benefits  of  a standard  format  for 
narrative  entries,  but  as  of  June  2000  the  Department  did  not  have  a policy  about  how  to 
use  the  case  narrative  to  record  information.  Finally,  the  Department  has  not  defined 
consequences  for  probation  officers  who  keep  inadequate  case  files. 

Because  they  cannot  refer  to  clear,  current  policies,  probation  officers  must  ask  procedural 
questions  of  whoever  is  available.  When  asked  in  our  employee  survey  about  the  one  thing 
they  would  change  in  the  Department  if  they  could,  13  of  73  respondents  mentioned 
unclear,  inconsistent  policies,  procedures,  and  priorities.  Besides  wasting  probation 
officers’  time  and  creating  frustration  as  they  search  for  proper  procedures,  according  to 
one  supervisor,  the  lack  of  clear  policies  and  procedures  means  that  employees  are  passing 
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along  their  individual  practices,  whether  correct  or  not,  thus  perpetuating  inconsistency  and 
inaccuracy. 

As  Chapter  5 discusses,  the  chief  recognizes  that  the  Department’s  policies  and  procedures 
need  substantial  improvement.  According  to  the  chief,  a committee  formed  in  spring  2000 
is  working  to  update  and  enhance  the  Department’s  policy  and  procedure  manual. 


SENIOR  MANAGEMENT  HAS  NOT  MANAGED  THE 
DEPARTMENT’S  WORKLOAD  ADEQUATELY 

Department  managers  attribute  many  of  the  gaps  in  probation  supervision  and  their 
difficulties  in  managing  the  Department  to  the  Department’s  heavy  workload  and  lack  of 
resources.  In  the  employee  survey  we  conducted,  34  of  85  respondents  cited  workload  as 
the  issue  the  Department  most  needs  to  address.  However,  despite  management’s  belief 
that  the  Department  does  not  have  enough  employees  to  handle  the  workload,  we  found 
that  the  Department’s  overall  staffing  is  comparable  to  that  of  similar  adult  probation 
functions  in  other  jurisdictions.  These  findings  and  other  evidence  suggest  that  the 
Department  would  benefit  most  from  reassessing  its  approach  to  workload  and  resource 
allocation.  The  Department  undertook  a reorganization  in  July  2000,  which  may  lighten 
employees’  workload;  however,  the  new  structure  leaves  a large  number  of  probationers 
without  any  supervision. 

Department  Staff  Feels  Overwhelmed 

by  Its  Workload 

Probation  officers  generally  feel  they  make  a positive  difference  in  probationers’  lives. 
However,  more  than  half  of  the  39  probation  officers  who  responded  to  our  employee 
survey  and  supervise  probationers  believe  they  are  unable  to  provide  probationers  with  an 
adequate  level  of  oversight  because  of  the  size  of  their  caseloads.  Thirteen  said  they  had 
cases  to  which  they  did  not  pay  attention.  One  supervisor  cited  high  caseload  sizes  as  a 
reason  for  lax  application  of  policy  requirements.  At  the  time  of  the  audit,  the  majority  of 
caseloads  contained  over  100  probation  cases;  10  of  the  69  caseloads  had  300  or  more 
cases. 

As  of  May  2000,  the  Department  was  staffed  to  its  budgeted  level,  which  is  the  highest  it 
has  been  since  fiscal  year  1993-94.  Nonetheless,  in  June  2000  more  than  1,500 
probationers  in  seven  caseloads  had  no  probation  officers  assigned  to  them  and,  therefore, 
were  receiving  no  supervision.  The  Department  did  not  reassign  these  probationers  to  other 
probation  officers  because  it  felt  that  current  caseload  sizes  were  already  too  large. 

Although  the  chief  and  his  senior  managers  acknowledge  that  workload  is  an  issue  and 
have  even  identified  potential  solutions,  they  have  been  slow  to  act  on  them.  For  example, 
the  Department  had  been  discussing  an  approach  to  managing  its  workload  that  would 
place  low-risk  probationers  who  require  a lower  level  of  supervision  in  large  banked 
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caseloads  and  leave  probation  officers  with  more  time  for  high-risk  cases,  a practice  which 
many  probation  agencies  follow.  In  July  2000,  only  after  two  years  of  discussion  and  a 
perceived  staffing  crisis  did  senior  management  develop  a policy  for  dealing  with  low-risk 
probationers. 

The  Numbers  of  Probation  Cases  and  Total 

Staff  Have  Remained  Relatively  Constant 

The  number  of  probation  cases  the  Department  supervises  has  not  changed  significantly 
over  the  last  10  years,  according  to  data  the  Department  reported  to  the  California 
Department  of  Justice  (Justice  Department).  The  Department’s  budget  has  seen  an  average 
increase  of  about  7 percent  per  year  over  that  period.  The  Department’s  number  of  total 
budgeted  positions  has  been  somewhat  more  variable.  However,  since  fiscal  year  1994-95, 
total  staff  levels  have  steadily  increased.  Exhibit  7 illustrates  these  probation  case  and 
staffing  trends. 

Exhibit  7 

Probation  Cases  and  Total  Budgeted  Staff 
1990  to  1999 
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* Stall' levels  are  positions  budgeted  for  the  fiscal  year  starting  in  the  year  reported.  For  example,  the  127 
employees  reported  for  1999  are  the  Department's  total  budgeted  positions  for  fiscal  year  1999-2000. 

**  Cases  for  1999  represent  December  1999  levels.  Case  figures  for  other  years  are  annual  averages. 

The  low  fluctuation  in  the  Department’s  probation  cases  contrasts  with  patterns  in  other 
California  counties.  Using  Justice  Department  data  covering  10  years,  we  evaluated 
numbers  of  adult  probation  cases  for  the  12  other  California  counties  nearest  in  population 
to  San  Francisco.  Relative  to  the  other  counties,  San  Francisco  has  one  of  the  most  stable 
annual  numbers  of  total  cases  as  well  as  the  smallest  difference  between  its  highest  and 
lowest  case  levels  over  the  period.  Appendix  A provides  details  about  the  probation  case 
data  from  each  county. 

In  having  a comparatively  predictable  number  of  probationers  and  a rising  staff  level,  San 
Francisco  is  in  an  advantageous  position  to  budget  resources,  plan  programs,  and  structure 
itself  to  carry  out  its  mission  efficiently.  Furthermore,  the  Department  has  done  a 
reasonable  job  in  filling  its  positions  when  vacancies  arise.  For  fiscal  years  1995-96 
through  1999-2000,  the  Department  had  an  average  rate  of  vacant  positions  (both  probation 
officer  and  non-probation  officer  positions)  per  pay  period  ranging  from  a high  of  3%  of  its 
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total  budgeted  staff  (about  3 positions)  in  fiscal  year  1996-97  to  a low  of  -3%  (about  4 
positions  over  its  total  budgeted  staff  level)  in  fiscal  year  1 999-2000.  However,  when  3 1 of 
39  of  the  probation  officers  with  caseloads  responding  to  our  survey  of  Department 
employees  say  they  spend  a lot  of  time  reacting  to  crises,  their  response  indicates  that 
management  has  not  provided  an  effective  structure  for  employees  to  address  a relatively 
constant  workload. 

The  Department's  Current  Staffing  Levels 
Are  Consistent  With  Adult  Probation 
Departments  in  Other  Counties 

Certain  factors  make  comparing  probation  departments  difficult.  Some  departments  may 
have  higher  percentages  of  misdemeanor  cases,  which  often  require  less  supervision.  In 
addition,  some  departments  may  receive  state  and  federal  funding  to  support  specialized 
caseloa  s,  which  can  carry  limits  on  the  size  of  those  caseloads. 

Taking  these  differences  into  consideration,  we  found — in  a separate  survey  of  probation 
departments  in  California  and  around  the  country — that  the  Department’s  current  level  of 
staffing  is  comparable  to  that  of  adult  probation  functions  in  other  jurisdictions. 

The  survey  included  jurisdictions  with  populations  and/or  adult  probation  caseload  sizes 
similar  to  that  of  San  Francisco  as  well  as  jurisdictions  identified  as  leaders  in  the  field  of 
probation.  Exhibit  8 on  this  and  the  following  page  displays  some  of  the  survey  results. 

Exhibit  8 

San  Francisco  Probation  Cases  and  Staffing  Compared  to  Other  Counties 
a.  Cases  Per  Full-Time  Equivalent  Employee 


Number  of  Probation  Cases 

NOTES:  Data  pertain  to  adult  probation  cases  and  staff  only.  Counties  are  in  California  unless  otherwise  noted. 
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Exhibit  8 (continued) 

San  Francisco  Probation  Cases  and  Staffing  Compared  to  Other  Counties 


b.  Cases  Per  Probation  Officer  c.  Cases  Per  Probation  Officer  With  Caseload 


Number  of  Probation  Cases 


Number  of  Probation  Cases 


NOTES:  Data  pertain  to  adult  probation  cases  and  staff  only.  Counties  are  in  California  unless  otherwise  noted. 


Although  San  Francisco  has  somewhat  fewer  total  staff  relative  to  the  number  of  cases  it 
supervises  than  average  (Exhibit  8a),  it  has  slightly  more  probation  officers  for  its  number 
of  cases  than  the  other  counties  have  (Exhibits  8b  and  8c).  For  details  about  the  survey  and 
the  caseload  and  staffing  data  on  which  we  based  our  analysis,  see  Appendix  B. 


Exhibit  9 shows  how  the  Department  can  have  more  probation  officers  but  fewer  total  staff 
than  the  other  counties  do.  San  Francisco  has  fewer  support  and  administrative  staff  as  a 
proportion  of  its  total  staff  than  all  but 
one  other  county  we  surveyed.  In  the 
county  with  the  highest  proportion  of 
support  staff,  employees  who  are  not 
probation  officers  constitute  49 
percent  of  total  staff. 


In  San  Francisco,  where  only  20 
percent  of  the  Department’s 
employees  are  not  probation  officers, 
the  results  of  our  survey  of 
department  staff  indicate  that 
administrative  tasks  consume  a large 
portion  of  the  workday  for  many  probation  officers  with  caseloads.  Of  39  probation 
officers  with  caseloads  responding  to  our  survey,  29  said  they  spend  a high  proportion  of 
their  time  writing  reports  and  completing  paperwork  rather  than  supervising  probationers. 
As  Exhibit  10  on  the  following  page  displays,  probation  officers  responding  estimate 
administrative  tasks  and  report  writing  take  up  almost  half  of  their  time,  while  engaging  in 
face-to-face  contact  with  probationers  averages  less  than  a third  of  their  workdays. 
Probation  officers  cannot  supervise  cases  effectively  when  unnecessary  paperwork 
consumes  their  time. 


Exhibit9 

Probation  Officers  as  a Percentage 
of  Total  Staff 
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Exhibit  10 


Probation  Officers’  Estimates  of  Their 
Use  of  Time  Over  an  Average  Month 
(37*  probation  officers  with  caseloads  responding) 
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Report  Contact  with  Contact  with  General  Preparing  Other 

preparation  probationer  probationer  administrative  for/appearing 
and  writing  (in  person)  (phone  or  mail)  duties  in  court 


* Two  of  the  39  probation  officers  with  caseloads  responding  to  the  survey  did  not  answer  this  question. 


Although  the  Department  believes  that  it  needs  additional  probation  officers  to  provide 
adequate  supervision  to  its  probationers,  the  chief  adult  probation  officer  has  stated  that 
most  other  adult  probation  departments,  at  least  in  California,  also  feel  understaffed.  As 
explained  later  in  this  chapter,  other  jurisdictions  have  responded  to  budget  and  staffing 
constraints  using  various  techniques  and  approaches  to  provide,  in  their  estimation,  the 
most  effective  probation  services  they  can.  The  next  section  describes  the  Department’s 
recent  efforts  to  reorganize  its  workload. 

The  Department’s  Reorganization  May 
Address  Workload  Concerns , but  It 
Leaves  Thousands  of  Probationers 
Without  Supervision 

In  July  2000,  the  Department  underwent  a reorganization  that  may  improve  workload  for 
staff,  but  which  allows  many  probationers  to  complete  their  sentences  without  complying 
with  their  court-ordered  conditions  of  probation.  The  chief  and  his  senior  managers 
developed  the  reorganization  plan  in  June  2000  in  response  to  what  they  deemed  a crisis 
precipitated  by  the  City’s  turning  down  their  request  for  additional  probation  officers. 

According  to  the  chief,  the  reorganization  centers  around  a new  policy  for  dealing  with 
lower-risk  probationers.  The  policy  asserts  that,  because  the  Department  lacks  sufficient 
staff  to  monitor  all  probationers,  it  will  continue  to  provide  necessary  supervision  only  to 
probationers  whom  it  considers  to  be  high  risk  to  the  community.  The  Department  will 
bank”  cases  that  do  not  require  active  involvement  by  the  probation  officer,  placing  them 
m one  large  caseload  with  no  supervision.  The  Department  estimates  that  the  banked 
caseload  will  contain  approximately  4,700  probationers  (about  3,500  felony  cases  and 
1,200  misdemeanor  cases),  or  45  percent  of  its  total  probation  cases.  Initially,  the 
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Department  intends  to  include  in  the  banked  caseload  only  those  cases  it  assesses  as 
medium  or  minimum  risk.  However,  it  has  planned  for  the  possibility  of  having  to  assign 
some  maximum-risk  probationers  to  the  banked  caseload. 

Removing  lower-risk  probationers  from  its  workload  will  allow  the  Department  to  focus  its 
resources  on  supervising  those  probationers  who  pose  the  greatest  danger  to  the 
community.  The  Department  intends  to  limit  the  size  of  its  maximum-risk  caseloads  to  100 
or  fewer  probation  cases.  Prior  to  the  reorganization,  over  a third  of  the  Department’s 
maximum-risk  caseloads  contained  more  than  100  probation  cases,  with  7 of  these 
caseloads  topping  200  cases  each. 

Although  the  Department’s  restructuring  represents  a step  toward  improving  supervision  of 
high-risk  probationers  and  addressing  important  issues  of  workload  and  resource 
allocation,  it  also  raises  several  concerns.  For  one,  the  Department’s  lack  of  oversight  of 
probationers  in  the  banked  caseload  means  that  these  offenders  will  be  able  to  complete 
their  sentences  without  complying  with  the  court-ordered  conditions  of  their  probation, 
including  payment  of  fines,  fees,  and  restitution,  registration  as  a sex,  drug,  or  arson 
offender,  and  participation  in  treatment  programs.  Probationers  assigned  to  the  banked 
caseload  will  receive  a letter  stating  that  they  must  comply  with  their  probation  conditions, 
but  the  Department  will  not  actually  review  the  cases  to  determine  whether  probationers 
are  in  fact  adhering  to  those  requirements.  In  addition  to  minimizing  the  impact  of 
probation  as  a punishment  and  limiting  the  chances  for  rehabilitation,  this  may  be  a 
dereliction  of  the  Department’s  duties  under  the  Penal  Code,  which  states  that  the  level  and 
type  of  supervision  be  consistent  with  the  court-ordered  conditions  of  probation. 
Furthermore,  the  Department  will  not  know  or  be  able  to  take  action  should  the  risk  profile 
of  a probationer  in  the  banked  caseload  worsen  and  pose  a potential  threat  to  the  public. 

The  Department’s  reorganization  is  also  troublesome  in  that  it  may  not  even  achieve  its 
implied  end  goal — the  improved  supervision  of  high-risk  probationers.  The  reorganization 
focused  solely  on  lowering  the  size  of  probation  officer  caseloads.  The  Department  did  not 
update  any  policies  or  establish  any  procedures  to  ensure  that  probationers  in  the 
supervised  caseloads  receive  proper,  much  less  improved,  oversight  from  probation 
officers.  As  previous  and  subsequent  sections  of  this  report  illustrate,  the  lack  of 
functioning  management  systems  and  clear,  up-to-date,  enforced  policies  and  procedures 
play  a significant  role  in  the  Department’s  inability  to  supervise  probationers  effectively. 
The  Department  must  address  these  aspects  of  its  operations  in  order  for  lower  caseload 
sizes  to  translate  into  lasting  and  measurable  improvements  in  probationer  supervision. 

The  practice  of  placing  lower-risk  probationers  in  large  caseloads  is  not  uncommon.  Over 
half  of  the  1 1 probation  agencies  we  surveyed  report  that  they  bank  some  probation  cases. 
However,  probation  agencies  typically  provide  some  means  to  ensure  that  probationers 
comply  with  the  conditions  of  their  probation.  For  example,  to  be  eligible  for  transfer  to 
their  reduced  supervision  caseload,  Arizona’s  Maricopa  County  requires  that  probationers 
first  establish  a pattern  of  making  payments  toward  their  financial  obligations  and 
complete  all  other  probation  requirements.  Once  in  the  reduced  supervision  caseload, 
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probationers  must  submit  a monthly  report  form  and  make  payments  on  their  financial 
obligations  or  risk  return  to  greater  supervision.  San  Bernardino  County  maintains  most  of 
its  12,000  probation  cases  in  one  caseload,  which  a team  of  probation  officers  supervise  by 
selecting  cases  at  random  to  check  for  compliance  with  probation  conditions.  Santa  Clara 
County  has  several  probation  officers  assigned  to  its  banked  caseload  of  about  7,500 
probationers  to  monitor  payments,  community  service  requirements,  and  new  arrests  and  to 
determine  whether  the  county  needs  to  resume  active  supervision  of  any  offenders. 

In  contrast,  the  Department’s  policy  for  banking  lower-risk  offenders  has  no  provision  for 
transferring  a probationer  back  to  a regular  supervision  caseload  or  for  returning 
probationers  to  Court  for  failure  to  comply  with  court-ordered  conditions  of  probation. 

As  a result,  the  Department  will  be  treating  probationers  assigned  to  the  banked  caseload 
more  leniently  than  offenders  sentenced  to  court  probation,  which  the  presiding  judge  of 
the  criminal  court  says  the  Court  considers  a lighter  sentence  than  probation  with  the  Adult 
Probation  Department.  According  to  the  assistant  division  chief  of  the  criminal  division, 
offenders  on  court  probation  are  responsible  to  the  Court  and  receive  no  supervision; 
however,  at  least  those  who  fail  to  pay  their  fines  or  fees  are  returned  to  Court  and 
sanctioned. 

Organizational  Innovations  Enable 

Other  Departments  to  Supervise  More 

Probationers  With  Fewer  Employees 

According  to  authorities  on  probation  management,  the  average  caseload  size  for  a 
department  such  as  San  Francisco’s  does  not  reveal  a great  deal  in  and  of  itself.  In  fact,  the 
American  Probation  and  Parole  Association  asserts  that  given  the  diversity  of  ways 
probation  departments  operate,  it  is  futile  and  counterproductive  to  search  for  national 
caseload  standards.  Organizational  innovations  enable  departments  to  supervise  a high 
number  of  cases  while  maintaining  adequate  supervision  of  probationers. 

For  example,  according  to  the  Los  Angeles  County  Probation  Department,  it  has  been  able 
to  manage  a doubling  of  its  adult  probation  cases  over  the  last  15  years  while  maintaining 
1978  staff  levels.  This  department  credits  its  ability  to  absorb  the  increase  in  workload  to 
caseload  expansion,  job  simplification,  automation,  and  use  of  temporary  employees  who 
have  lower  classifications  than  probation  officers.  The  department  also  states  that  staff 
have  been  able  to  adjust  to  almost  constant  change  without  loss  of  commitment  or  essential 
effectiveness.  Use  of  automated  systems  allows  Los  Angeles  County  Probation  to  maintain 
a ratio  of  one  probation  officer  to  1,000  probationers  for  the  majority  of  its  cases.  Certain 
high  risk  probationers  continue  to  receive  traditional  supervision,  with  lower  ratios  of 
probation  officers  to  probationers. 

San  Bernardino  County  Probation  reports  that  it  responded  to  increasing  average  caseload 
sizes  by  reorganizing  itself  into  field  units  and  an  office  unit.  The  field  units  interact  with 
probationers  in  the  community  and  assist  other  law  enforcement  agencies.  The  office  unit 
is  responsible  for  ongoing  case  file  management.  San  Bernardino  reports  that  the 
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restructuring  has  enabled  it  to  provide  more  active  supervision  to  a larger  number  of 
probationers  than  it  could  provide  previously. 

Other  Departments  Augment  Probation 
Officer  Staff  in  Innovative  Ways 

Unlike  San  Francisco’s  Adult  Probation  Department,  probation  agencies  in  other 
jurisdictions  make  creative  use  of  volunteer,  administrative,  and  support  staff  to  assist  with 
probationer  case  management.  For  example,  Sonoma  County  uses  probation  assistants  at  a 
ratio  of  one  assistant  to  every  10  probation  officers  to  help  with  case  administration.  The 
Los  Angeles  County  Probation  Department  supplements  its  staff  with  reserve  deputy 
probation  officers  and  1,400  volunteers  who  provide  a variety  of  services  to  probationers. 

It  also  uses  unpaid  college  interns,  who  receive  college  credit,  to  work  with  low-risk 
caseloads  and  the  gang  suppression  unit. 

The  Seattle  Municipal  Court  Probation  Services’  Volunteer  Program  has  also  used 
volunteer  staff  extensively  to  support  its  probation  officers  in  working  with  drunk  driving 
and  domestic  violence  offenders.  The  program  uses  senior  citizens,  student  interns,  and 
professional  people  to  help  monitor  selected  probation  cases.  Among  other  tasks, 
volunteers  conduct  intake  interviews,  monitor  cases  for  compliance,  communicate  with 
treatment  agencies,  enter  case  information  into  the  computer  database,  and  prepare  reports 
for  court. 

San  Francisco  would  benefit  from  looking  to  these  and  other  jurisdictions  for  new  ideas  on 
ways  to  augment  its  staff  and  enhance  the  productivity  of  its  probation  officers. 

Better  Use  of  Integrated  Information 
Systems  Could  Improve  the  Department’s 
Ability  to  Supervise  Probationers 

The  Department  uses  no  single  system  for  managing  its  probation  cases,  a situation  that 
inhibits  effective  caseload  management.  Instead,  the  Department  uses  a variety  of  in-house 
and  county,  state,  and  federal  criminal  justice  automated  systems,  most  of  which  are  not 
linked  to  each  other.  In  June  1998,  the  Department  catalogued  10  different  methods — 
mostly  manual — that  it  used  to  track  probation  case  assignments  and  at  least  half  are  still  in 
use.  The  Department  also  has  seven  proprietary  in-house  computer  applications  in  place. 
Following  the  lead  of  probation  departments  in  other  counties,  the  Department  needs  to 
replace  its  current  manual  and  information  systems  with  a single  automated  system  that 
will  allow  probation  officers  to  spend  more  time  meeting  with  probationers  and  less  time 
completing  paperwork. 

Our  survey  of  probation  departments  in  other  counties  and  additional  research  revealed 
many  ways  that  automation  has  made  caseload  management  for  probation  officers  more 
efficient.  For  example,  case  management  systems  help  departments  create  statistics, 
monitor  performance,  keep  records  and  archives,  and  route  data  to  the  courts  and  other 
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departments.  Probation  officers  in  some  counties  also  use  laptop  computers  in  the  field  to 
assist  with  supervision  of  active  probationers. 

To  date,  the  Department’s  approach  to  information  systems  has  focused  on  reacting  to  the 
needs  of  individual  units  or  probation  officers.  For  example,  under  the  previous  chief  adult 
probation  officer  the  Department  supported  development  of  several  case  management 
applications.  Although  these  systems  benefit  some  probation  officers  in  their  day-to-day 
tasks,  according  to  county  information  systems  staff,  none  link  to  other  systems  to  share 
data  or  assist  managers  in  overseeing  probation  officers’  supervision  of  probation  cases. 

Another  example  of  the  Department’s  underutilization  of  information  systems  exists  in  the 
probation  component  of  the  City’s  Court  Management  System  (CMS),  which  the 
Department  uses  to  research  cases  and  enter  certain  data.  According  to  county  information 
systems  staff,  the  probation  component  of  CMS  could  have  provided  the  Department  with 
the  ability  to  track  the  number  and  status  of  its  probation  cases;  however,  the  Department 
has  not  used  it  for  this  purpose.  The  aging  system  is  now  perceived  by  many  as  failing  and 
unreliable.  An  information  systems  contractor  for  the  CMS  says  both  the  court  clerks  and 
the  Department’s  front  desk  staff  can  make  errors  in  data  entry  that  may  not  be  corrected. 
As  discussed  in  this  chapter,  the  Department  has  relied  on  flawed  systems  to  track  its 
number  of  probation  cases. 

The  current  chief  would  like  to  expand  the  Department’s  use  of  information  systems  to 
manage  its  probation  cases  and  has  initiated  efforts  to  locate  a suitable,  unified  case 
management  system.  Fortunately,  the  Department  of  Telecommunications  and  Information 
Services  (DTIS)  has  been  working  on  behalf  of  the  City’s  criminal  justice  departments  to 
select,  purchase,  and  install  a replacement  to  the  aging  CMS  database  at  no  cost  to  the 
Department.  In  addition  to  the  same  type  of  criminal  justice  data  now  in  the  CMS,  the  new 
system — named  the  Justice  Tracking  and  Information  System  (JUSTIS) — will  include  case 
management  components  for  many  of  the  City’s  criminal  justice  departments,  including 
the  Adult  Probation  Department.  According  to  the  DTIS  manager  on  the  project,  DTIS  will 
supply  funding  and  technical  support  to  install  the  system.  DTIS  issued  its  request  for 
proposals  in  May  2000  and  expects  to  begin  implementing  the  system  selected  by  the 
Department  over  the  next  year. 

The  request  for  proposal  for  the  CMS  replacement  invites  vendors  to  fill  a wide  range  of 
case  management  needs  which,  if  implemented  fully,  should  provide  the  Department  with 
a powerful  tool  for  improving  its  oversight  of  probation  cases  and  for  enhancing 
productivity.  By  linking  to  the  criminal  justice  data  in  JUSTIS,  the  Department  will  no 
longer  need  to  rewrite  and  reenter  case  information.  Staff  will  be  able  to  track 
systematically  probationers’  compliance  with  their  conditions  of  probation  and  thus 
provide  management  with  the  means  to  review  probation  officers’  supervision  of 
probationers.  The  Department  will  be  able  to  report  the  number  and  status  of  probation 
cases  easily  and  reliably.  A fully  implemented  system  should  streamline  and  unify  the  case 
management  process  and  make  the  supervision  of  probationers  more  efficient,  and  enable 
supervisors  to  more  effectively  manage  probation  officers  and  their  caseloads. 
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The  potential  of  the  JUSTIS  system  to  improve  the  Department’s  efficiency  and 
effectiveness  in  supervising  probationers  is  marked.  Its  success  depends  on  both  the  level 
of  fulfillment  of  the  request  for  proposal  requirements  by  the  selected  vendor  and  the 
Department’s  ability  to  develop  a clear  plan  for  use  of  the  system  to  improve  the  overall 
functioning  of  the  Department  and  to  implement  the  plan  fully. 


RECOMMENDATIONS 

To  improve  its  supervision  of  probationers  and  the  ability  to  serve  and  protect  the  citizens 

of  San  Francisco  efficiently  and  effectively,  the  Department  should  take  the  following 

steps: 

• Conduct  a count  of  all  open  cases  and  revise  case  data  accordingly.  The  Department 
should  also  develop  controls  to  ensure  that  its  case  statistics  remain  accurate  and  fix  its 
probation  case  reporting  spreadsheet  so  that  it  totals  case  data  correctly. 

• Establish  and  enforce  controls,  such  as  periodic  reviews  of  random  probation  case  files, 
to  ensure  that  probation  officers  are  providing  adequate  supervision  to  their 
probationers  and  that  probationers  are  complying  with  the  court-ordered  conditions  of 
their  probation.  The  Department  should  document  the  level  of  supervision  probation 
officers  are  providing  and  follow  up  on  instances  of  substandard  performance. 

• Develop  policies  that  clearly  define  what  constitutes  adequate  supervision  for 
probationers  at  various  levels  of  risk  and  need  as  well  as  the  documentation  each  case 
file  should  contain.  The  policies  should  include  standards  regarding  the  frequency  of 
contact  between  the  Department  and  probationers  and  the  documentation  necessary  to 
verify  compliance  with  registration,  treatment,  and  enrollment  requirements  and  state 
the  consequences  for  failing  to  adhere  to  the  policies. 

• Consider  alternative  methods  of  managing  workload,  such  as  increased  use  of  support 
staff,  interns,  and  volunteers,  to  provide  more  effective  service  to  probationers. 

• Revise  the  July  2000  policy  dealing  with  lower-risk  probationers  to  establish  some 
level  of  review  of  the  cases  in  the  banked  caseload  and  procedures  for  returning  cases 
to  regular  supervision  or  to  Court.  Methods  of  review  the  Department  should  consider 
include  using  clerical  staff  to  verify  compliance  with  registration  and  certain  other 
requirements  and  establishing  a team  of  qualified  staff  dedicated  to  testing  cases 
selected  at  random  to  determine  compliance  with  court-ordered  probation  conditions. 

• Implement  an  integrated  case  management  system  that  will  allow  the  Department  to 
more  readily  and  accurately  track  its  number  of  probation  cases  as  well  as  probationer 
compliance  with  conditions  of  probation.  The  Department  should  work  closely  with  the 
Department  of  Telecommunications  and  Information  Services  which  has  already 
offered  to  purchase  and  install  such  a system  at  no  cost  to  the  Department. 
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CHAPTER  2 

POOR  MANAGEMENT  OF  COLLECTIONS  DEPRIVES  VICTIMS, 
THE  CITY,  AND  THE  STATE  OF  THE  MONEY  OWED  THEM 


CHAPTER  SUMMARY 

Although  the  Adult  Probation  Department  (Department)  has  identified  its  inadequate 
performance  in  collections  as  an  issue  it  needs  to  address,  so  far  it  has  not 
confronted  the  problem  effectively,  resulting  in  significant  lost  revenues  to  victims 
of  crimes,  the  City  and  County  of  San  Francisco  (City),  and  the  State  of  California  (State). 
More  than  67  percent  of  probationers  owing  money  have  never  made  a payment.  We  also 
found  that  46  percent  of  all  probationers  have  bad  addresses  and  thus  do  not  receive  bills. 
Bad  addresses  and  missing  information  in  the  Department’s  accounting  system  could  be 
costing  the  Department  more  than  $360,000  per  year. 

The  Department  makes  little  effort  to  collect  once  accounts  are  delinquent,  creating  an 
impression  among  probationers  and  department  staff  that  paying  financial  obligations  is 
not  required.  As  of  December  1999,  $7.7  million  was  past  due  on  open  probation  cases. 

The  Department  also  lacks  an  adequate  process  to  determine  probationers’  ability  to  pay, 
and  this  weakness  results  in  a potentially  significant  amount  of  money  on  its  books  that  it 
cannot  reasonably  expect  to  collect.  Consequently,  not  all  of  the  $7.7  million  outstanding  is 
collectable.  In  an  important  step,  the  Department  hired  a senior  collections  officer  in  June 
2000;  however,  it  has  not  taken  advantage  of  other  no-  and  low-cost  resources  that  are 
available  to  assist  the  Department  in  enhancing  its  collections. 


BACKGROUND 

The  California  Penal  Code  (Penal  Code)  permits,  and  in  some  cases  mandates,  the 
imposition  of  fines,  fees,  restitution,  or  a combination  of  these  penalties  as  a condition  of 
probation.  The  Department  is  responsible  for  determining  an  offender’s  ability  to  pay  and 
for  making  recommendations  to  the  state  Superior  Court  for  the  County  of  San  Francisco 
(Court)  regarding  the  appropriate  types  and  amounts  of  fines  and  fees.  A typical  probation 
order  from  the  Court  might  require  a probationer  to  pay  a booking  fee,  costs  for 
investigation  and  probation,  and  a fine  to  the  State.  The  Court  can  also  order  offenders  to 
pay  restitution  to  the  victim(s)  of  the  crime.  In  our  review  of  207  probation  cases,  we  found 
that  the  Court  had  ordered  more  than  90  percent  of  probationers  to  fulfill  one  or  more 
financial  obligations  as  part  of  their  sentences. 

The  Department  has  a cashier’s  office  that  tracks  court-ordered  financial  obligations, 
receives  payments,  and  forwards  money  to  the  State  and  victims.  The  cashier’s  office  uses 
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a comprehensive  accounting  system  to  record  detailed  data  regarding  each  case  and  to 
generate  monthly  bills.  Nonetheless,  each  probation  officer  has  the  responsibility  to  ensure 
probationers’  compliance  with  financial  obligations,  to  follow  up  on  cases  with  amounts 
overdue,  and  to  return  cases  to  Court  if  probationers  do  not  meet  their  financial  obligations. 


The  money  the  Department  collects  from 
probationers  goes  to  three  primary  recipients:  the 
City,  the  State,  and  victims  of  crimes.  Exhibit  1 1 
shows  that  in  fiscal  year  1998-99,  almost  half  of  the 
$1.2  million  collected  remained  in  the  City,  which 
received  39  percent  for  the  City’s  general  use  and  8 
percent  for  specific  uses.  The  State  and  victims  of 
crimes  received  the  remaining  53  percent. 


Exhibit  11  Recipients  of 
Fiscal  Year  1998-99  Collections 


PROBATIONERS  HAVE  NOT  PAID 
MORE  THAN  $7  MILLION  DUE 


As  of  December  1999,  probationers  owed  the  Department  $7.7  million  in  fines,  fees,  and 
restitution.  This  sum  represents  all  amounts  past  due  on  open  probation  cases  recorded  in 
the  Department’s  accounting  system.  Exhibit  12  describes  characteristics  of  the 
Department’s  cases  with  financial  obligations  and  provides  some  explanation  of  the  large 
amounts  outstanding. 


Exhibit  12 

Attributes  of  Open  CasesOwing  Fines,  Fees,  and/or  Restitution 
June  Through  December  1999 
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Cases  w ith  amounts  Cases  that  have  never  Cases  w ith  bad  Cases  paying  in  a Cases  paying 
past  due  made  a payment  addresses  given  month*  regularly** 

* a payment  of  $ 1 or  more 

**  a payment  of  $ 1 or  more  each  month  forthe  three  most  recent  months 


Not  all  of  the  $7.7  million  outstanding  is  collectable.  Based  on  recommendations  from  the 
Department,  the  Court  orders  fines  and  fees  from  some  probationers,  including  homeless 
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individuals,  who  have  no  means  to  pay.  Because  the  Department  does  not  adequately 
assess  or  document  probationers’  ability  to  pay,  we  were  not  able  to  ascertain  the 
proportion  of  delinquent  amounts  that  is  potentially  collectable.  However,  given  the 
Department’s  inadequacies  in  collecting  from  probationers,  which  this  chapter  describes, 
we  believe  the  Department  could  increase  collections  significantly  by  improving  its 
management  of  probationers’  financial  obligations. 

The  Department  Collects  Only  About 

1 7 Percent  of  the  Current  Amount  Due 

Each  Month 

On  average,  the  Department  collects  just  17  percent  of  the  current  amount  due  and  payable 
each  month.  The  current  amount  due  for  a given  month  is  the  sum  of  each  active 
probationer’s  monthly  payment  rate,  and  it  does  not  include  amounts  past  due.  Using  data 
from  the  last  seven  months  of  1999,  we  found  that  probationers  owe  an  average  of  $78  per 
month.  Because  the  Department  has  about  7,575  open  cases  that  owe  money,  a total  of 
approximately  $590,000  in  fines,  fees,  and  restitution  on  7,575  cases  becomes  due  and 
payable  to  the  Department  each  month.  The  Department’s  monthly  collections,  however, 
average  only  $102,000,  or  about  $13.50  per  case. 

The  Department’s  Collection  Rate 

Has  Declined 

Although  collections  had  a net  increase  between  fiscal  years  1995-96  and  1998-99,  the 
increase  was  not  the  result  of  the  Department’s  collecting  a greater  percentage  of  the  total 
financial  obligation  due — that  is,  improving  its  collection  rate.  Rather,  it  was  due  to  a rise 
in  the  average  amount  the  Court  ordered  probation  cases  to  pay. 

Exhibit  13  charts  collections  and  the 
average  amount  ordered  per  case 
from  fiscal  years  1995-96  through 
1998-99.  During  this  period,  the 
average  amount  the  Court  ordered 
probation  cases  to  pay  increased  by 
29  percent  while  the  amount  the 
Department  collected  rose  by  only 
26  percent.  Because  the  number  of 
cases  the  Court  ordered  to  pay  fines 
and  fees  over  that  period  remained 
steady,  collections  should  have  risen 
proportionally  to  amounts  ordered  if 
the  Department  had  maintained  its 
collection  rate.  That  collections  increased  less  than  amounts  ordered  is  evidence  that  the 
Department’s  collection  rate  decreased  over  those  four  years. 


Exhibit  13  Annual  Collections  and 
Average  Amount  Ordered  Per  Case 
Fiscal  Years  1995-96  Through  1998-99 


1995-96  1996-97  1997-98  1998-99 
I Annual  Collections  — Avg  Amount  Ordered  ftr  Case 
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THE  DEPARTMENT  HAS  NOT  MANAGED 
COLLECTIONS  ADEQUATELY 


To  his  credit,  the  chief  adult  probation  officer  (chief)  has  identified  collection  of 
probationer  fines  and  fees  as  an  issue  the  Department  needs  to  address.  He  believes  the 
Department  could  be  collecting  more  and  has  stated  that  he  wants  to  improve  the  system  of 
collection.  However,  the  Department’s  collection  processes  and  procedures  have  seen  little 
change  in  support  of  this  goal. 

The  Department  Does  Not  Know  How 

Much  Money  Probationers  Owe 

The  Department  has  not  taken  steps  to  analyze  systematically  the  collection  problem  or  its 
magnitude.  Among  other  things,  it  does  not  know  the  total  amount  that  probationers  owe 
each  month,  the  number  of  probationers  who  are  supposed  to  make  payments,  or  the 
number  of  probationers  who  do  pay.  Senior  managers  receive  only  one  piece  of  collection 
information:  the  Department’s  total  monthly  revenues.  They  do  not  receive — and, 
according  to  the  Department’s  head  cashier,  have  not  asked  for — information  essential  to 
evaluating  the  Department’s  overall  collection  performance  and  to  identifying  areas  in 
need  of  attention. 

The  information  the  Department  needs  to  analyze  its  collections  is  available.  The 
Department’s  mainframe  accounting  system  houses  a significant  array  of  data,  including 
probationer  financial  obligations,  payment  histories,  amounts  due,  and  the  status  of  cases. 
Our  analysis  of  data  from  the  system  allowed  us  to  identify  areas  of  low  performance  and 
develop  appropriate  recommendations  for  addressing  the  problems  Tevealed. 

Missing  and  Inaccurate  Information 

Could  Be  Costing  the  Department  More 

Than  $ 360,000  per  Year 

Because  the  Department  has  made  little  effort  to  understand  its  collections,  two  important 
problems  have  escaped  attention  and  resulted  in  lost  revenue.  Data  for  approximately  2,000 
cases  ordered  to  pay  fines,  fees,  or  restitution  are  missing  from  the  accounting  system.  In 
addition,  we  found  that  between  June  and  December  1 999  the  Department  had  no  current 
addresses  for  an  average  of  46  percent  of  probationers  with  financial  obligations  and  could 
not  send  them  bills,  thus  lowering  the  likelihood  these  probationers  would  pay. 

Our  review  of  207  randomly  selected  probation  cases  revealed  that  92  percent  of  cases 
include  orders  to  fulfill  financial  obligations  as  part  of  the  sentences.  However,  the 
Department’s  accounting  system,  which  is  supposed  to  include  all  cases  with  financial 
obligations,  contains  records  for  only  72  percent  of  the  open  probation  cases  under  the 
Department’s  supervision,  a discrepancy  of  20  percent.  Further  research  confirmed  a 
significant  discrepancy.  We  tested  the  accounting  system  for  20  probation  cases  that  should 
have  been  recorded  and  found  that  3,  or  15  percent,  were  missing.  The  cashier’s  office 
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corroborates  this  finding,  asserting  that  sometimes  a probationer  will  come  to  the  window 
to  pay  and  the  cashier’s  office  will  have  no  record  of  the  case. 

Cases  ordered  to  pay  fines  and  fees  but  not  on  record  with  the  cashier’s  office  reflect 
potential  collections  that  are  forgone  by  the  Department.  If  cases  missing  from  the 
accounting  system  pay  at  rates  similar  to  cases  recorded  in  the  system,  we  can  estimate  that 
the  approximately  2,000  missing  cases  should  make  payments  totaling  more  than  $3 15,000 
annually.  Cases  missing  from  the  accounting  system  do  not  receive  bills  and  do  not  appear 
on  the  account  status  reports  sent  to  unit  supervisors  and  probation  officers  each  month. 
Further,  the  cashier’s  office  cannot  accept  payment  without  the  case’s  being  in  the 
accounting  system.  Though  unlikely,  the  possibility  also  exists  that  a probation  officer 
could  inappropriately  accept  payment  directly  from  these  probationers. 

Cases  in  the  accounting  system  without  current  addresses  also  represent  potentially  forgone 
collections.  We  found  that  probationers  who  receive  bills  are  13  times  more  likely  to  make 
payments  than  those  probationers  who  do  not  receive  bills.  If  the  Department  updated  just 
10  percent  of  the  incorrect  addresses  and  those  probationers  increased  their  payment  rates 
to  the  level  paid  by  probationers  currently  receiving  bills,  the  Department  would  collect  an 
additional  $55,000  per  year.  It  appears  that  the  high  number  of  missing  and  incorrect 
addresses  in  the  accounting  system  reflects  probation  officers’  failure  to  inform  the 
cashier’s  office  of  address  changes  rather  than  the  officers’  lack  of  knowledge  of  their 
probationers’  whereabouts. 

These  gaps  in  information  result  from  flaws  in  the  Department’s  process  for  transferring 
case  data  to  the  cashier’s  office,  which  has  no  way  to  ensure  that  it  receives  information  on 
every  case  that  it  should.  Furthermore,  keeping  the  cashier’s  office  informed  appears  not  to 
be  a priority  for  the  Department.  Although  probation  officers  and  unit  supervisors  receive 
monthly  reports  from  the  accounting  system  listing,  among  other  things,  all  open  cases 
owing  money  and  those  with  bad  addresses,  they  are  not  encouraged  or  required  to  verify 
the  information  or  correct  errors.  The  Department  does  not  track  or  report  any  collection 
data  according  to  divisions,  units,  or  probation  officers.  If  it  did,  unit  supervisors  and 
probation  officers  might  feel  more  compelled  to  keep  the  cashier’s  office  informed. 

Without  such  oversight,  it  is  not  surprising  that  probation  officers  and  unit  supervisors  give 
higher  priority  to  other  activities,  such  as  responding  to  court  requests,  which  are  tracked 
and  carry  negative  consequences  for  poor  performance. 

Despite  Stated  Priorities,  Senior 

Managers  Have  Taken  Limited  Steps  to 

Improve  Collections 

Since  at  least  1997,  senior  management  has  expressed  concern  about  the  Department’s 
collections.  Besides  the  important  step  of  hiring  a senior  collections  officer  in  June  2000, 
however,  management’s  actions  to  address  collections  have  been  limited. 
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During  this  time  period,  one  of  management’s  main  actions  to  improve  collections  has 
been  to  seek  approval  to  add  a collections  officer  position  to  the  Department’s  budget. 
After  repeated  attempts,  the  Department  received  funding  in  its  fiscal  year  1999-2000 
budget  to  hire  a half-time  senior  collections  officer;  however,  almost  a full  year  passed 
before  it  filled  the  position.  In  its  fiscal  year  2000-01  budget,  the  Department  changed  this 
job  to  a full-time  position.  As  discussed  in  the  following  section,  over  these  years, 
management  has  also  contacted  collection  agencies  regarding  the  possibility  of  pursuing 
probationers  delinquent  in  their  payments.  However,  as  of  June  2000,  the  Department  had 
yet  to  take  additional  steps  to  implement  collections  on  overdue  accounts. 

Furthermore,  management  has  not  ensured  that  staff  members  understand  the  importance 
of  collection  and  what  needs  to  be  done  to  carry  it  out  effectively.  The  Department’s  only 
action  toward  this  end  has  been  an  oral  directive  from  the  chief  to  unit  supervisors  in  1998 
that  limited  the  waiving  of  probationer  fines  and  fees.  The  Department  has  neither 
published  a policy  or  statement  regarding  the  effort  to  improve  collections  nor  undertaken 
action  to  assist  probation  officers  in  enhancing  probationer  compliance  with  financial 
obligations. 


CRITICAL  ELEMENTS  OF  AN  EFFECTIVE 
COLLECTIONS  PROGRAM  ARE  LACKING 

Not  only  have  senior  management’s  efforts  to  improve  collections  been  limited,  but  the 
Department’s  collections  process  also  has  additional  weaknesses  that  reduce  the 
Department’s  ability  to  be  effective.  Specifically,  the  Department  does  not  adequately 
consider  whether  a probationer  has  the  means  to  pay,  impose  sanctions  regularly  for  failure 
to  meet  financial  obligations,  or  take  measures  to  collect  from  overdue  accounts  and  closed 
cases.  Allowing  probationers  to  avoid  compliance  with  terms  of  probation  by  neglecting 
their  financial  obligations  not  only  violates  the  law,  but  it  promotes  an  impression  that  the 
Department  is  ineffective  in  supervising  probationers.  Probationers  who  do  not  pay  and  are 
not  sanctioned  for  failing  to  pay  will  learn  that  the  Department  will  not  hold  them  to  the 
terms  of  probation,  and  these  probationers  may  share  this  information  with  others  in  the 
system. 

The  Department’s  management  acknowledges  many  of  these  deficiencies  but  appears  to  be 
relying  on  the  senior  collections  officer  to  address  them. 

Probation  Officers  Do  Not  Sufficiently 
Assess  Each  Probationer’s  Ability  to  Pay 

The  Department  does  not  consistently  or  adequately  evaluate  each  probationer’s  capacity 
to  pay  fines  and  fees  and  thus  imposes  unreasonable  financial  obligations  on  some 
probationers.  This  has  encouraged  noncompliance  among  probationers  to  become  standard, 
expected,  and  accepted. 
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Determination  of  a probationer’s  ability  to  pay  is  a critical  step  in  the  collections  process. 
If  done  properly,  this  assessment  allows  the  probation  officer  to  establish  a financial 
obligation  and  payment  schedule  that  is  reasonable — one  against  which  the  Department 
can  plausibly  measure  compliance.  The  chief  recognizes  the  importance  of  this  step  and 
has  stated  that  the  collections  officer  will  play  a key  role  in  improving  the  Department’s 
process  for  evaluating  a probationer’s  ability  to  pay. 

The  primary  tool  probation  officers  use  to  assess  ability  to  pay  is  a financial  statement 
form,  in  which  probationers  disclose  their  financial  circumstances.  The  California  Penal 
Code  states  that  determination  of  an  offender’s  ability  to  pay  shall  take  into  account  the 
individual’s  present  financial  position,  his  or  her  reasonably  discemable  future  financial 
position  (no  more  than  one  year  from  date  of  hearing),  the  likelihood  that  he  or  she  will 
obtain  employment,  and  “any  other  factor  or  factors.” 

Before  an  offender’s  sentencing,  probation  officers  are  supposed  to  assess  the  offender’s 
ability  to  pay  fines  and  fees  and  to  recommend  to  the  Court  an  amount  to  pay  based  on  that 
determination.  After  sentencing,  probation  officers  are  to  set  a payment  schedule,  monitor 
payments  according  to  the  schedule,  and  return  the  case  to  Court  if  the  probationer  has  not 
made  payments.  Probation  officers  can  modify  or  waive  certain  fees  ordered  by  the  Court 
if  they  determine  the  probationers  do  not  have  the  ability  to  pay. 

However,  the  Department’s  form  does  not  collect  sufficient  information  for  a useful 
assessment.  The  Department’s  financial  statement  form  is  flawed  because  it  only 
documents  information  regarding  an  offender’s  current  financial  circumstances.  It  does  not 
allow  the  offender  to  indicate  his  or  her  earning  potential  or  employment  history. 

Moreover,  the  Department  does  not  use  its  financial  statement  forms  consistently.  We 
reviewed  207  probation  case  files  and  36  percent  did  not  include  any  financial  statements 
from  the  probationers.  Further,  detailed  review  of  10  of  the  files  for  cases  with  financial 
obligations  revealed  that  many  forms  are  not  current.  Of  the  five  files  that  contained 
financial  statement  forms,  four  had  forms  with  information  from  previous  offenses  but 
none  pertaining  to  the  current  offenses. 

The  Penal  Code  states  that  the  burden  of  proof  is  on  offenders  to  show  their  ability  or 
inability  to  pay  financial  obligations.  Department  policy  requires  probation  officers  to 
check  the  information  each  offender  provides  and  to  verify  facts  pertinent  to  the  offender’s 
capacity  to  pay.  However,  according  to  a community  services  division  director,  probation 
officers’  heavy  workloads  make  verifications  difficult.  The  incentives  for  offenders  to 
provide  false  or  incomplete  information  are  clear  and  underscore  the  importance  of  the 
Department’s  verifying  each  offender’s  stated  ability  to  pay.  The  Department  needs  to 
review  welfare  check  stubs,  confirm  use  of  homeless  shelters,  or  check  other  relevant 
information. 
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Probation  Officers  Do  Not  Regularly 
Sanction  Probationers  for  Failing  to  Pay 
Court-Ordered  Fines  and  Fees 

Probation  officers  seldom  return  cases  to  Court  for  failure  to  meet  financial  obligations 
even  though  Department  policy  specifically  instructs  probation  officers  to  do  so. 
Probationers  must  demonstrate  both  the  ability  and  the  unwillingness  to  pay  in  order  for 
the  case  to  be  returned  to  Court.  In  our  review  of  207  probation  case  files,  we  found 
egregious  examples  of  cases  in  which  probationers  had  not  paid  fines,  fees,  or  restitution. 
We  also  did  not  see  any  evidence  in  the  207  files  that  the  Department  had  requested 
motions  to  extend  the  individual’s  probation. 

Even  probationers  who  have  the  means  to  pay  their  financial  obligations  are  not  doing  so. 
For  example,  one  probationer  owed  $4,715,  and  the  case  file  included  mention  of  his 
savings  and  retirement  accounts,  current  employment,  and  plans  to  buy  a house  as  well  as 
the  probation  officer’s  notes  that  the  probationer  had  clearly  indicated  that  he  did  not 
intend  to  pay  his  fees.  The  case  terminated  ‘successfully’  with  no  payments  made.  In 
another  case,  the  probationer  owed  $495,  and  the  case  file  contained  a series  of  pay  stubs 
and  monthly  reports  of  money  he  was  earning  while  on  probation.  The  case  narrative  made 
no  mention  of  the  money  the  probationer  owed.  Again,  the  case  closed  with  no  payments. 

A community  services  division  director  stated  that  the  Department  has  neither  the  time  nor 
the  money  to  return  cases  to  Court  for  failing  to  pay  fines  and  fees.  The  chief 
acknowledged  that  the  inadequacy  of  its  process  for  determining  probationers’  ability  to 
pay  also  makes  it  difficult  for  probation  officers  to  return  cases  to  Court  since  the  Court 
can  sanction  only  those  nonpaying  probationers  with  established  capacities  to  pay.  In 
contrast,  9 of  1 1 probation  departments  we  surveyed  regularly  return  cases  to  Court  to 
extend  or  revoke  probation  for  failure  to  pay  fines,  fees,  or  restitution. 

The  Department  Takes  Little  Action  to 
Collect  From  Overdue  Accounts 

In  addition  to  not  regularly  subjecting  the  probationers  with  delinquent  accounts  to  court 
sanctions,  the  Department  does  not  use  other  methods  to  promote  payment  on  overdue 
accounts.  By  not  pursuing  delinquent  probationers,  the  Department  is  not  complying  with  a 
San  Francisco  Administrative  Code  (Administrative  Code)  provision  that  requires 
departments  to  refer  certain  overdue  accounts  receivable  to  the  Bureau  of  Delinquent 
Revenue,  a division  of  the  San  Francisco  Tax  Collector  authorized  to  collect  money  due  to 
the  City.  The  chief  was  unaware  of  this  requirement  prior  to  the  audit. 

Nor  does  the  Department  contract  with  a collections  agency  or  take  any  other  formal  action 
(such  as  using  credit  reports,  notification  letters,  or  withholding  of  wages  and  tax  refunds) 
to  encourage  or  gamer  payment  from  probationers  with  amounts  past  due.  The  Department 
used  to  participate  in  the  California  Franchise  Tax  Board’s  program  that  withholds  tax 
refunds  and  lottery  winnings  from  probationers  with  overdue  fines  and  fees.  According  to 
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the  Department’s  former  business  manager,  the  Department  collected  $25,000  to  $30,000 
per  year  through  the  program,  but  it  stopped  participating  when  it  changed  business 
managers  in  1997.  Neither  the  former  nor  the  current  business  manager  could  explain  why 
the  Department  no  longer  participates. 

The  Department  has  met  with  various  collection  agencies  since  November  1 997  to  discuss 
collecting  from  its  delinquent  probationer  accounts.  According  to  the  chief,  one  private 
firm,  which  collects  money  owed  to  organizations,  did  not  comply  with  the  City’s  equal 
benefits  ordinance.  The  Department  has  also  met  with  the  State’s  Franchise  Tax  Board, 
which  runs  programs  that  assist  local  governments  with  collection  activities.  However,  as 
of  June  2000,  the  Department  had  taken  no  further  steps  toward  implementing  a program  to 
collect  overdue  fines,  fees,  and  restitution  from  probationers. 

The  Department  Does  Not  Collect  Money 

Probationers  Owe  After  Their  Cases  Close 

The  Department  does  not  attempt  to  collect  from  cases  once  they  close  even  though  the 
Penal  Code  allows  such  collections.  As  a result,  it  is  effectively  writing  off  the  unpaid 
fines,  and  the  City  is  losing  money.  We  found  that  at  least  three-quarters  of  cases  owing 
money  complete  their  probation  terms  with  amounts  still  due.  The  Department  has  a policy 
from  1983  prohibiting  probation  officers  from  closing  cases  at  the  ends  of  their  probation 
terms  unless  probationers  meet  their  financial  obligations,  but  the  Department  no  longer 
enforces  this  rule. 

Not  collecting  fines,  fees  and  restitution 
from  closed  cases  could  result  in  the 
loss  of  significant  revenue  for  the 
Department.  Exhibit  14  shows  the 
magnitude  of  fines  and  fees  forgone  on 
cases  that  reached  the  ends  of  their 
probation  terms  still  owing  money  for 
six  months  in  late  1999  and  early  2000.  As  a result  of  not  billing  or  attempting  to  collect 
from  closed  cases,  the  Department  is  effectively  writing  off  as  uncollectable  approximately 
$3.6  million  each  year.  This  amount  includes  financial  obligations  for  probationers  with  no 
capacity  to  pay,  so  we  were  unable  to  determine  the  proportion  of  this  amount  that  is 
collectable. 

The  Department’s  lack  of  collection  from  closed  and  overdue  accounts  differentiates  it 
from  probation  departments  in  other  jurisdictions.  In  our  survey  of  peer  jurisdictions,  we 
found  that,  in  addition  to  returning  cases  to  Court  to  extend  or  revoke  probation,  every  one 
of  the  1 1 surveyed  jurisdictions  took  some  action  to  collect  from  overdue  accounts  after 
probation  cases  terminated. 


Exhibit  14 

Cases  Terminated  With  Amounts  Still  Owed 
August  1999 — January  2000 

Number  of  Cases  934 

Average  Uncollected  Per  Case  $1 ,935 

Total  Uncollected  $1.8  million 
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COLLECTION  RESOURCES  ARE 
AVAILABLE  AT  LITTLE  OR  NO  COST 


Programs  and  services  are  available  that  can  help  the  Department  collect  overdue  fines  and 
fees  for  a reasonable  cost.  Although  the  Administrative  Code  requires  that  departments 
send  delinquent  accounts  to  the  City’s  Bureau  of  Delinquent  Revenue  (Bureau),  paying 
bureau  staff  to  collect  these  accounts  may  be  more  expensive  for  the  Department  than  some 
of  the  other  options  described  below.  The  Department  should  consult  with  the  City 
Attorney’s  Office  before  pursuing  these  other  options. 

California’s  Franchise  Tax  Board  administers  two  programs  to  assist  local  government 
agencies  in  collecting  money  owed  to  them:  the  Interagency  Intercept  Collections  program 
(intercept  program)  and  the  Court-Ordered  Debt  Collections  program  (debt  collections 
program).  For  a small  fee  for  each  case,  the  intercept  program  withholds  tax  refunds  and 
lottery  winnings  from  debtors  and  redirects  this  money  to  where  it  is  owed.  Before  1997, 
when  it  participated  in  the  intercept  program,  the  Department  received  between  $25,000 
and  $30,000  per  year  from  this  program,  according  to  the  Department’s  former  business 
manager. 

The  debt  collections  program  obtains  payments  on  court-ordered  debts  by  withholding 
bank  accounts,  wages,  commissions,  and  rents  on  behalf  of  participating  courts.  The 
program  requires  no  up-front  fee,  but  it  retains  as  commission  up  to  15  percent  of  the  total 
amount  it  collects.  Because  of  the  variables  involved,  we  were  not  able  to  estimate  the 
amount  of  revenues  the  Department  could  realize  from  this  program. 

Private  companies  also  offer  collection  services.  One  company  we  contacted,  which 
collects  court-ordered  debts  for  counties  in  Washington  and  Arizona,  charges  an  average 
fee  of  between  18  percent  and  22  percent  of  the  fine  and  civil  assessment  balance,  with  a 
provision  that  the  Department  could  retain  50  percent  of  each  assessment.  The  company 
can  set  up  a noncontractual  “pilot”  program  with  the  Department  that  would  allow  it  to 
determine  more  exactly  the  amount  of  revenue  that  it  could  recover  for  the  Department. 

The  City’s  Bureau  of  Delinquent  Revenue  provides  yet  another  option.  However,  unlike 
the  Franchise  Tax  Board  or  the  private  companies  that  collect  on  debts,  the  Bureau  does 
not  work  on  commissions  and  would  create  out-of-pocket  costs  for  the  Department.  The 
Bureau  requires  funds  from  a City  agency  to  cover  personnel  costs  before  it  will  take  on 
any  new  collection  projects.  The  Bureau  was  unable  to  estimate  the  potential  return  it 
might  achieve  on  the  Department’s  overdue  accounts  because  of  the  number  of  unknown 
variables. 

The  State  Board  of  Control  has  money  available  through  its  Revenue  Recovery  and 
Compliance  Division  to  fully  fund  positions  to  help  counties  increase  their  collection  of 
restitution.  The  District  Attorney’s  Office  has  one  such  position,  a restitution  specialist,  on 
staff  currently  and  has  been  helping  the  Department  apply  for  similar  funding. 
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The  California  Penal  Code.  Section  1463.007.  contains  an  additional  option.  As  an 
incentive  for  counties  and  courts  to  establish  collections  programs,  this  provision  allows 
jurisdictions  to  retain  a portion  of  money  that  would  otherwise  go  to  the  State  to  cover  the 
costs  of  operating  a comprehensive  program  to  collect  overdue  fines  and  forfeitures.  The 
program  must  be  a distinct  collection  function  that  employs  certain  collection  techniques, 
such  as  use  of  credit  reports  and  Department  of  Motor  Vehicles  information.  The  associate 
director  of  collections  for  San  Bernardino  County  estimates  that  the  provision  covers 
funding  for  80  percent  of  the  county’s  collection  costs  related  to  probation  sentences. 

RECOMMENDATIONS 

To  enhance  probationers’  compliance  with  court  orders  for  financial  obligations  and  to 
increase  collections  that  benefit  the  City,  the  State,  and  victims  of  crimes,  the  Adult 
Probation  Department  should  take  the  following  actions: 

• Establish  controls  to  ensure  that  the  cashier’s  office  in  the  Department  receives  all  the 
information  it  should  with  regard  to  cases  owing  fines,  fees,  and  restitution. 

• Develop  and  report  performance  measures  for  the  Department  and  its  divisions,  units, 
and  probation  officers  that  track  payments  of  fines,  fees  and  restitution.  Among  other 
things,  these  measures  should  gauge  the  rate  of  collection  for  probationers  with 
financial  obligations  and  the  percentage  of  cases  with  incorrect  addresses. 

• Strengthen  the  procedures  for  determining  an  offender’s  ability  to  pay  by  expanding  the 
financial  information  requested,  developing  methods  and  standards  for  verification  of 
that  information,  and  requiring  use  of  the  information  to  establish  financial  obligations 
at  reasonable  levels. 

• Update  and  enforce  the  policy  specifying  steps  to  take  when  probationers  fail  to 
comply  with  financial  obligations.  These  steps  should  include  returning  cases  to  Court 
to  extend  probation. 

• Consult  with  the  City  Attorney’s  Office  to  determine  whether  the  Department  can 
contract  directly  with  an  agency  other  than  the  Bureau  of  Delinquent  Revenue  to 
collect  from  delinquent  accounts.  If  necessary,  seek  a change  to  the  San  Francisco 
Administrative  Code  to  allow  such  a contract. 

• Contract  with  the  Franchise  Tax  Board’s  Interagency  Intercept  Collections  program 
and  its  Court-Ordered  Debt  Collections  program  to  collect  from  open  and  closed 
delinquent  accounts.  If  the  state  option  is  unavailable,  the  Department  should  contract 
with  a private  debt  collection  agency. 

• Develop  its  collection  ability  further  by  applying  to  the  State’s  Board  of  Control  for 
funding  for  a position  to  assist  the  Department  in  collecting  restitution  orders  and  fines. 
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• Work  with  the  Superior  Court  to  evaluate  the  potential  of  a collaborative  collections 
function  that  could  be  eligible  for  funding  under  the  terms  of  Penal  Code  Section 
1463.007. 
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CHAPTER  3 

THE  DEPARTMENT’S  INVESTIGATIONS  DIVISION  PRODUCES 
REQUIRED  REPORTS  BUT  NEEDS  TO  IMPROVE  ITS  DATA 
COLLECTION  AND  DOCUMENTATION 


CHAPTER  SUMMARY 

The  state-mandated  presentence  reports  that  the  Investigations  Division  (division)  of 
the  Adult  Probation  Department  (Department)  produces  to  guide  the  State  of 
California  Superior  Court  for  the  County  of  San  Francisco  (Court)  in  its  sentencing 
decisions  are  complete,  and  the  division  generally  delivers  them  in  a timely  manner. 
However,  the  number  of  continuances,  which  require  rescheduling  the  sentencing  dates  for 
offenders,  is  rising.  Continuances  can  leave  in  the  community  for  extended  periods  of  time 
offenders  who  will  be  sentenced  to  jail,  and  can  contribute  to  jail  overcrowding  by  leaving 
incarcerated  offenders  in  jail  longer  than  necessary.  Although  the  division  generally  does 
not  have  control  over  continuances,  it  could  help  identify  ways  to  keep  them  at  a minimum 
by  sharing  the  information  it  collects  on  their  causes  with  the  Court  and  law  enforcement 
agencies. 

Our  conclusions  are  based  on  data  we  developed  because  we  found  the  division’s  statistics 
for  total  reports,  late  reports,  and  continuances  unreliable.  Without  accurate  information 
about  workload  and  performance,  the  division  may  not  be  able  to  manage  its  resources  in 
the  most  effective  manner  or  to  identify  areas  of  opportunity  or  need.  Fortunately,  the 
division  plans  to  implement  an  enhanced  database  system  that  will  automate  the 
assignment  of  reports  and  provide  more  accurate  statistics  about  the  division’s  activity.  The 
division  could  also  realize  gains  in  productivity  and  report  quality  by  establishing  a more 
formal  process  for  the  judges  who  use  these  reports  to  comment  on  their  quality. 


BACKGROUND 

Presentence  reports,  the  primary  reports  the  division  produces,  guide  the  Court  in  its 
decisions  on  sentencing  offenders.  Supplemental  reports,  which  the  division  prepares  less 
frequently,  provide  additional  information  to  the  Court  for  cases  in  which  the  division  has 
already  written  presentence  reports,  but  in  which  the  offenders  have  failed  to  appear  for 
sentencing  and  arrest  warrants  have  been  issued.  The  division  also  produces  a number  of 
shorter  reports,  such  as  brief  reports  for  cases  in  which  the  Court  is  sentencing  offenders  to 
state  prison. 

Under  the  California  Penal  Code  (Penal  Code),  probation  officers  are  responsible  for 
investigating  and  reporting  to  the  Court  the  circumstances  surrounding  felony  offenses  and 
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the  prior  history  and  records  of  convicted  individuals.  The  Penal  Code  also  requires  that 
probation  officers  make  recommendations  to  grant  or  deny  probation.  When  they 
recommend  probation,  probation  officers  must  also  recommend  to  the  Court  the  conditions 
of  probation.  Because  the  Court  cannot  impose  a sentence  on  an  individual  without  a report 
from  the  division,  the  division  is  accountable  to  the  Court  for  producing  the  reports  the 
Court  requests. 


Exhibit  1 5 summarizes  the  number  of  reports  requested  by  the  Court  and  assigned  to 
probation  officers  for  fiscal  years  1996-97  through  1998-99.  Despite  a decrease  in  the  total 
number  of  reports  requested  over  this  period,  the  division’s  overall  workload  remained 
steady  because  of  an  increase  in  presentence  reports  which  occurred  in  fiscal  year  1998-99. 
According  to  the  division  director,  presentence  reports  take  longer  than  other  reports  to 
prepare. 

Exhibit  15 

Investigations  Division 
Reports  Requested  by  the  Court 
Fiscal  Years  1996-97  Through  1998-99 
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NOTE:  Supplemental  reports  declined  because  in  the  past  the  division  assisted  the  community 
services  divisions  in  completing  these  reports,  but  ceased  doing  this  in  fiscal  year  1 998-99. 
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At  the  time  of  this  audit,  the  division  had  a total  of  27  probation  officers  organized  into 
three  units.  An  investigations  clerk  processes  requests  from  the  Court  and  provides  other 
support  for  the  division.  Unit  supervisors  assign  reports  the  Court  requests  to  the  division’s 
probation  officers  on  a rotating  basis,  according  to  the  investigations  clerk,  and  he  enters 
the  case  information  into  a computer  database.  After  probation  officers  complete  reports 
and  supervisors  review  and  approve  them,  he  delivers  them  to  the  court  offices. 


THE  INVESTIGATIONS  DIVISION  PRODUCES 
TIMELY,  COMPLETE  REPORTS 

The  division  is  generally  delivering  on  time  presentence  and  supplemental  reports  (reports) 
to  the  Court.  It  is  also  complying  with  Penal  Code  requirements  regarding  the  information 
presentence  reports  must  contain. 
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The  Division  Generally  Meets  Deadlines 
for  Presentence  Reports 

In  its  budget  for  fiscal  year  2000-01,  the  division  reported  that  in  fiscal  year  1998-99,  it 
delivered  95  percent  of  its  reports  to  the  Court  on  time.  Our  analysis  of  division  records  for 
fiscal  years  1996-97  through  1998-99  confirmed  this  figure  and  showed  that  the  timeliness 
of  report  delivery  had  generally  improved  over  the  period.  In  fiscal  years  1996-97  and 
1997-98,  we  estimated  the  percentage  of  reports  delivered  timely  was  90  percent  and  87 
percent,  respectively. 

The  Penal  Code  requires  that  a presentence  report  be  delivered  to  the  Court  at  least  five 
days  before  the  date  fixed  by  the  Court  for  an  offender’s  hearing  for  sentencing.  However, 
according  to  the  division  director,  several  years  ago  the  Department  and  the  Court  agreed 
that  reports  delivered  to  Court  two  days  prior  to  a hearing  would  be  considered  timely.  The 
division  counts  as  late  those  reports  that  reach  the  Court  in  time  for  the  scheduled  hearing 
but  not  within  the  two-day  time  frame.  For  example,  the  division  views  as  late  a report 
delivered  to  the  Court  one  day  before  the  hearing  date.  If  a report  is  not  ready  by  the 
hearing  date,  the  division  must  request  a continuance  from  the  Court.  The  division  tracks 
continuances  separately  from  late  reports. 

Presentence  Reports  We  Reviewed 
Comply  With  Penal  Code  Requirements 

Not  only  does  the  division  usually  deliver  reports  on  time,  it  also  complies  with  the  Penal 
Code  requirements  for  report  content.  During  our  review  of  probation  case  files,  we 
examined  a sample  of  13  presentence  reports  and  found  each  contained  the  required 
information.  The  Penal  Code  specifies  that  a presentence  report  must  include  the  facts  and 
circumstances  of  the  crime,  a summary  of  the  offender’s  record  of  prior  criminal  conduct, 
information  concerning  any  victims,  the  offender’s  eligibility  for  probation,  the  offender’s 
ability  to  pay  restitution  or  fines  or  to  satisfy  other  conditions,  and  the  probation  officer’s 
recommendation. 

Judges  Surveyed  Are  Generally  Satisfied 
With  Presentence  Reports 

A survey  we  conducted  revealed  that  judges  are  generally  satisfied  with  presentence 
reports  they  receive  from  the  division  with  respect  to  the  reports’  completeness,  accuracy, 
relevancy,  format,  readability,  and  overall  usefulness  for  the  judges’  decision  making.  We 
surveyed  the  1 8 judges  who  receive  presentence  reports  and  received  nine  responses. 

Our  survey  asked  a variety  of  questions,  and  four  of  the  judges  expressed  concern  about  the 
timeliness  of  presentence  reports.  However,  as  explained  below,  reports  can  be  late  for 
reasons  outside  the  control  of  the  division.  The  survey  also  asked  the  judges  for 
suggestions  for  streamlining  reports.  One  suggestion  was  to  eliminate  the  repetition  of  facts 
and  circumstances  of  crimes  in  different  sections  of  the  presentence  reports.  We  discussed 
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this  suggestion  with  the  division  director,  who  indicated  he  would  review  this  issue  with 
his  staff. 

According  to  the  division  director,  the  division  and  the  Court  interact  as  needed,  but  the 
Court  has  no  formal  system  for  evaluating  the  division’s  performance  or  for  exchanging 
ideas  about  ways  to  improve  its  reports  and  productivity.  As  a result,  the  division  is  not 
taking  advantage  of  a valuable  source  of  information  that  could  foster  enhancements  and 
innovations  in  its  operations.  By  using  a periodic  survey  or  another  formal  mechanism, 
such  as  semiannual  meetings,  the  division  could  systematically  solicit  comments  and 
recommendations  from  the  judges  on  its  performance  and  potential  innovations. 


THE  NUMBER  OF  CONTINUANCES 
REQUESTED  BY  THE  DIVISION  HAS  RISEN 

Although  the  division  generally  delivers  presentence  reports  to  the  Court  on  time.  Exhibit 
16  shows  that  continuances  requested  as  a percentage  of  presentence  reports  requested 
increased  between  January  1998  and  November  1999.  The  division  requests  continuances 
when  it  cannot  complete  a report  by  the  hearing  date  and  another  hearing  must  be 
scheduled. 


Exhibit  16 

Continuances  as  a Percentage  of  Presentence  Reports  Requested 
January  1998  Through  November  1999 


By  lengthening  the  time  between  conviction  and  sentencing,  continuances  can  leave  in  the 
community  for  extended  periods  of  time  offenders  who  will  be  sentenced  to  jail.  When 
requested  for  cases  in  which  the  offender  remains  in  jail  between  conviction  and 
sentencing,  continuances  can  also  burden  the  City’s  jails  and  contribute  to  jail 
overcrowding.  Lastly,  continuances  are  sources  of  inefficiency  in  the  court  system  because 
they  require  the  Court,  attorneys,  and  other  parties  to  spend  time  rescheduling. 

Continuances  are  a result  of  convicted  individuals  failing  to  appear  at  the  division  for  an 
intake  interview,  which  the  division  requires  before  it  can  complete  a presentence  report,  or 
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other  circumstances  that  prevent  the  division  from  producing  a report  by  the  hearing  date. 
In  some  cases,  the  division  has  limited  influence  over  its  need  to  request  continuances. 
Nevertheless,  opportunities  may  exist  for  the  division  and  the  Court  to  minimize 
continuances  in  the  future.  The  division  retains  copies  of  its  continuance  request  forms, 
which  include  case  information  and  describe  the  circumstances  that  require  the  additional 
time.  However,  although  the  division  tracks  the  number  of  continuances  it  requests  each 
month,  it  does  not  analyze  the  information  on  the  request  forms.  Compiling  and  analyzing 
information  about  the  circumstances  resulting  in  continuances  or  the  characteristics  of  the 
cases  or  offenders  could  help  the  division,  the  Court,  and  law  enforcement  agencies 
identify  trends  and  provide  insight  into  ways  to  limit  continuances. 


THE  INVESTIGATIONS  DIVISION’S 
DATA  COLLECTION  AND  REPORTING 
NEED  IMPROVEMENT 

We  tested  the  division’s  statistics  for  total  reports,  late  reports,  and  continuances  and  found 
discrepancies  between  what  the  division  reported  and  our  results.  For  example,  for  the 
period  January  1998  through  June  1999,  the  division  reported  that  it  had  assigned  5,625 
reports  to  probation  officers  while  the  division’s  database  showed  5,754  reports  had  been 
assigned,  a difference  of  129  reports.  In  addition,  the  division  calculated  that  in  fiscal  year 
1997-98,  96  percent  of  its  reports  were  delivered  to  Court  on  time.  However,  we  calculated 
the  number  of  late  reports  in  four  sample  months  of  that  year  and  found  that  only  87 
percent  were  delivered  timely.  Further,  the  division  reported  that  continuances  for  the 
period  January  1998  through  June  1999  totaled  973,  but  we  tabulated  continuances  for  the 
same  period  and  found  998,  a difference  of  25. 

Inaccurate  information  about  performance  can  have  an  adverse  effect  when  it  is  used  by 
decision  makers  both  within  and  outside  the  Department.  For  example,  because  the 
Department  reports  as  a performance  measure  in  its  budget  the  percentage  of  the  division’s 
reports  delivered  on  time  to  the  Court,  this  information  is  available  to  the  City,  the  Court, 
and  the  public.  Unless  the  measure  is  based  on  accurate  data,  it  will  not  present  a true 
picture  of  the  division’s  performance  from  year  to  year  and  could  lead  decision  makers  to 
inappropriate  conclusions  regarding  trends  in  the  division’s  activities.  In  addition,  without 
accurate  performance  information,  the  Department  will  not  be  able  to  make  reliable 
comparisons  to  past  performance,  make  accurate  assessments  of  its  current  performance,  or 
set  appropriate  goals  for  improving  future  performance. 

The  data  discrepancies  we  found  appear  to  derive  from  inconsistencies  in  the  ways  staff 
compiles  statistics,  manual  computational  processes  that  are  prone  to  error,  and 
management’s  lack  of  verification  of  data.  Because  the  division’s  statistics  are  unreliable, 
we  developed  our  own  methodology  to  arrive  at  the  numbers  of  reports  assigned,  reports 
delivered  late,  and  continuances  requested.  Fortunately,  the  division  plans  to  implement  an 
enhanced  database  system  that  will  automate  the  assignment  of  reports  and  provide  more 
accurate  statistics  about  the  division’s  activity. 
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The  Investigations  Division  Has  Not  Used 
for  Reporting  Purposes  the  Data  Available 
in  Its  Existing  Database 

Although  it  maintains  a database  of  all  reports  requested  by  the  Court  and  assigned  to 
probation  officers,  the  division  does  not  use  the  information  in  the  database  for  any  data 
reporting  purposes.  The  division  relies  instead  on  individual  probation  officers  to  tally 
manually  the  numbers  of  reports  assigned  to  them  each  month  and  to  present  the  totals  to 
their  supervisors,  who  enter  the  totals  on  a spreadsheet. 

We  tested  the  accuracy  and  completeness  of  the  information  in  the  database  and  found  it 
reliable.  A programmer  who  provides  computer  assistance  to  the  division  was  able  to 
furnish  us  with  a report  detailing  the  number  and  types  of  reports  assigned  to  probation 
officers  over  the  last  several  years.  The  division  could  also  use  this  database  to  generate 
statistics  on  the  timeliness  of  reports  and  on  continuances;  however,  division  management 
does  not  use  this  resource  in  this  way.  Although  the  system  contains  a field  for  entering  the 
date  the  division  delivers  a report  to  Court,  the  division  calculates  the  number  of  late 
reports  by  referring  to  dates  that  the  investigations  clerk  enters  into  a logbook.  Likewise, 
the  database  contains  a field  for  continuances  requested.  The  division  has  not  used  this 
field,  however.  Instead  it  has  relied  on  staff  to  manually  count  the  numbers  of  continuance 
request  forms  completed  each  month  to  arrive  at  the  division’s  total  number  of 
continuances. 

A manual  process  for  tallying  and  reporting  data  is  less  efficient  and  introduces  more 
opportunities  for  clerical  and  computational  errors  than  does  an  automated  process.  If  the 
investigations  clerk  entered  the  reports’  delivery  dates  into  the  database  ratner  than 
recording  them  manually  in  a logbook,  a summary  of  the  timeliness  report  could  involve 
the  push  of  a button  instead  of  time-consuming,  manual  calculations  each  month. 

The  Investigations  Division ’s  New  Case 
Assignment  System  Could  Improve  Data 
Reliability 

During  our  review,  the  division  was  testing  and  preparing  to  implement  an  enhanced 
database  system  developed  by  the  City’s  Department  of  Telecommunications  and 
Information  Services.  Each  day  the  new  system  will  automatically  assign  reports  to 
individual  officers,  thus  eliminating  the  need  for  supervisors  to  assign  cases  manually.  It 
also  offers  several  automated  reporting  functions,  including  summaries  of  total  reports 
assigned  and  a calculation  of  late  reports  delivered  for  any  range  of  dates  required. 

If  used  to  its  fullest  capacity,  the  new  system  should  minimize  reporting  errors  and 
improve  the  quality  and  amount  of  performance  data  available  to  the  division.  Howe  ver,  as 
in  the  case  of  the  old  system,  the  division  faces  the  risk  of  failing  to  take  advantage  of  the 
new  system’s  capabilities.  Division  and  department  management  will  need  to  oversee 
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closely  the  system’s  implementation  and  to  develop  clear  policies,  procedures,  and  other 
controls  to  ensure  that  the  division  uses  the  new  system  as  intended. 


RECOMMENDATIONS 

To  ensure  that  the  information  on  its  productivity  that  the  division  collects  and  reports  is 
complete  and  accurate  and  that  this  information  will  be  useful  for  measuring  and 
evaluating  its  performance  in  the  future,  the  Investigations  Division  of  the  Adult  Probation 
Department  should  do  the  following: 

• Develop  a method,  such  as  a periodic  survey  or  semiannual  meetings,  to  obtain  formal 
evaluations  from  the  judges  regarding  the  quality  and  usefulness  of  reports  the  division 
sends  them  and  to  solicit  ideas  for  improvements  and  innovations. 

• Compile  and  analyze  information  from  continuance  request  forms  so  that  the 
Department  and  the  Court  can  use  this  data  to  identify  trends  and  to  develop  methods 
for  keeping  the  number  of  continuances  to  a minimum. 

• Proceed  with  the  implementation  of  the  new  database  system  and  eliminate  the  manual 
processes  of  collecting  and  reporting  information. 

• Establish  and  enforce  clear  policies  and  procedures  regarding  use  of  the  new  database 
system.  These  policies  and  procedures  should  outline  the  duties  and  responsibilities  of 
staff  who  are  responsible  for  entering,  verifying,  and  reviewing  information  in  the 
system. 
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CHAPTER  4 

PLANNING  AND  REPORTING  PROCESSES  ARE  INADEQUATE  TO 
GUIDE  THE  DEPARTMENT’S  OPERATIONS 


CHAPTER  SUMMARY 

The  Adult  Probation  Department  (Department)  of  the  City  and  County  of  San 
Francisco  (City)  is  not  fulfilling  the  requirement  of  the  San  Francisco 
Administrative  Code  (Administrative  Code)  that  city  departments  develop  strategic 
plans  that  provide  direction  towards  achieving  their  missions  and  goals.  Although  the 
department  has  an  ongoing  task  force  composed  of  management  and  staff  which  is 
examining  a number  of  operational  areas  in  the  Department  and  which  has  implemented  a 
number  of  changes,  it  is  not  engaged  in  a long-term  strategic  planning  process.  Further,  the 
Department  has  not  developed  a clear  vision  of  its  future,  a component  of  strategic 
planning,  that  is  linked  to  achievement  of  a mission  that  remains  consistent.  Additionally, 
the  Department’s  goals  and  objectives  lack  clarity  and  do  not  always  tie  directly  to  its 
mission.  Without  the  crucial  elements  of  a strategic  plan,  the  Department  cannot  function 
efficiently  or  supervise  probationers  effectively.  Moreover,  the  City,  the  State  of  California 
Superior  Court  for  the  County  of  San  Francisco  (Court),  and  the  public  will  not  have  the 
information  they  need  to  evaluate  the  Department’s  performance. 

Although  it  has  neglected  to  develop  successfully  a strategic  plan,  the  Department  has 
improved  the  formulation  of  the  performance  measures  it  includes  in  its  annual  budget. 
However,  it  needs  to  supplement  these  with  outcome  measures  that  reflect  the  effectiveness 
of  its  activities,  such  as  whether  the  Department’s  supervision  of  probationers  deters  them 
from  committing  additional  crimes. 

The  Department  also  needs  to  produce  regular  management  reports  and  to  improve  the 
reliability  of  its  data  so  that  the  results  it  presents  are  meaningful.  Because  senior 
management  does  not  regularly  review  data  showing  the  Department’s  performance  in 
various  areas,  it  has  only  limited  ability  to  make  timely,  well-informed  decisions  regarding 
departmental  activities.  Finally,  the  Department  has  not  complied  with  the  San  Francisco 
Administrative  Code  requirement  to  issue  an  annual  report  on  its  operations,  losing  a 
significant  opportunity  to  report  its  accomplishments  to  the  City,  the  Court,  the  public,  and 
the  Department’s  own  staff. 


BACKGROUND 

According  to  the  Administrative  Code,  “Waste  and  inefficiency  in  City  programs 
undermine  the  confidence  of  San  Francisco  residents  and  reduce  the  City’s  ability  to 
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adequately  address  vital  public  needs.  The  City  is  seriously  disadvantaged  in  its  efforts  to 
improve  program  efficiency  and  effectiveness  because  of  insufficient  articulation  of 
program  vision,  mission  and  goals,  including  inadequate  information  on  program 
performance.  And  the  Board  of  Supervisors’  policy  making,  spending  decisions,  and 
program  oversight  are  seriously  handicapped  by  insufficient  attention  to  program 
performance  and  results.” 

The  San  Francisco  Charter,  Section  9.1 14,  addresses  these  concerns  by  requiring  that  each 
department  describe  its  activities  and  their  costs,  and  provide  the  Mayor  and  the  Board  of 
Supervisors  certain  budget  details  including: 

• The  overall  mission  and  goals  of  the  department. 

• The  service  outcomes  desired  by  the  customer(s)  or  client(s)  of  the  department’s 
programs  and  activities. 

• Strategic  plans  that  guide  each  program  or  activity. 

• Productivity  goals  that  measure  the  department’s  progress  toward  achieving  its 
strategic  plans. 

The  Administrative  Code,  Section  3.5,  further  requires  that  each  department  identify  policy 
outcome  measures,  which  are  also  referred  to  as  performance  measures.  These  measures 
should  reflect  a department’s  mission  and  goals  and  help  its  management  and  the  Board  of 
Supervisors  gauge  the  department’s  progress  toward  attaining  these  goals.  In  addition,  each 
department  must  develop  and  annually  review  a three-year  strategic  plan  that  is  consistent 
with  its  approved  budget  and  that  reflects  the  outcomes  the  department  seeks  from  its 
operations. 

Thus  each  department  must  engage  in  strategic  planning,  which  is  a disciplined  effort  that 
helps  guide  an  organization  from  where  it  is  to  where  it  wants  to  be.  This  process  requires 
an  organization  to  articulate  a clear  vision  of  the  future,  identify  the  goals  and  objectives 
necessary  to  achieve  the  vision,  and  develop  means  to  measure  results  and  progress  toward 
the  goals.  In  its  structured  approach  to  evaluating  an  organization’s  position  and  potential, 
strategic  planning  fosters  orderly,  informed  decision  making  and  successful 
implementation  of  change.  Based  on  authoritative  literature  and  the  Controller’s 
Performance  Measurement  Instructions,  we  developed  a model  of  the  strategic  planning 
process,  which  Exhibit  1 7 on  the  following  page  describes. 


THE  DEPARTMENT’S  LACK  OF  A COMPREHENSIVE 
PROCESS  FOR  STRATEGIC  PLANNING  IMPEDES 
EFFECTIVE  SUPERVISION  OF  PROBATIONERS 

The  Department’s  budget  submissions  for  fiscal  years  1999-2000  and  2000-01  do  not 
indicate  that  it  has  complied  with  the  Administrative  Code  requirement  to  develop  a 
strategic  plan.  Based  on  our  discussions  with  the  Department  and  documents  it  provided. 


48 


CONTROLLER’S  AUDITS  DIVISION 


Exhibit  17 

Strategic  Planning  Process 


JL 


PERFORMANCE 

MEASURES 


A future-oriented  process  of  diagnosis  of  problem  areas,  objective- 
setting, and  strategy  building  that  is  an  essential  part  of  quality 
management.  This  process  relies  on  careful  consideration  of  an 
organization’s  capacities  and  environment  and  leads  to  significant 
decisions  about  allocation  of  resources.  Strategic  planning  emphasizes 
effective  uses  of  resources  to  achieve  meaningful  results. 


A compelling  image  of  the  desired  future.  Vision  is  the  inspiration  for  all 
other  components  of  the  strategic  planning  process. 


A broad,  comprehensive  statement  of  purpose  that  identifies  what  the 
department  does  (or  should  do)  and  for  whom  it  performs  its 
responsibilities. 

The  Adult  Probation  Department’s  current  mission  is  the  following: 
To  serve  and  protect  the  citizens  of  San  Francisco  through  the 
investigation  and  supervision  of  adult  criminal  offenders. 


Broad  statements  that  describe  desired  outcomes,  such  as  improving 
probationer  compliance  with  court-ordered  conditions  of  probation. 
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we  determined  that  the  Department  does  not  have  a clear  understanding  of  the  strategic 
planning  process  and  thus  cannot  comply  with  the  requirement  in  the  near  future.  More 
importantly,  the  absence  of  a formal  plan  hinders  the  Department’s  ability  to  supervise 
probationers. 

The  Department  initiated  its  Strategy  Task  Force  in  the  first  quarter  of  1998.  The  group, 
composed  of  management  and  staff,  first  raised  such  issues  as  developing  a vision, 
mission,  goals,  and  objectives,  which  are  components  of  strategic  planning.  However,  the 
group  never  carried  out  a formal  process  for  strategic  planning.  Finally,  calling  itself  the 
“task  force,”  the  group  published  a mission  statement  for  itself  that  did  not  address 
strategic  planning.  Instead,  the  statement  focused  on  operational  issues,  such  as  improving 
the  Department’s  filing  system  and  increasing  its  use  of  technology.  The  primary  source  of 
information  about  the  task  force’s  work  is  its  meeting  minutes.  Although  the  minutes 
indicate  there  has  been  considerable  discussion  among  task  force  members  resulting  in 
identification  of  areas  for  improvement  and  suggestions  for  actions  to  take,  some  of  which 
have  occurred,  there  is  no  indication  in  these  documents  that  the  task  force  was  engaged  in 
the  establishment  of  departmental  goals  and  objectives  tied  to  its  mission.  Therefore, 
although  the  task  force  has  implemented  a number  of  improvements  in  the  Department,  it 
has  not  engaged  in  a long-term  strategic  planning  process. 

The  Department  Should  Develop  a 

Vision  and  Link  It  to  a Single , 

Unchanging  Mission  Statement 

The  Department  needs  to  communicate  to  its  employees  its  vision  for  the  future.  According 
to  the  chief  adult  probation  officer  (chief),  he  and  his  senior  staff  have  attempted  to 
improve  communication  with  employees  and  employee  morale  by  having  open  meetings 
and  posting  minutes  of  meetings.  However,  when  asked  in  our  employee  survey  whether 
the  Department  has  a strategy  in  place  for  future  growth  and  improvement,  45  percent  of 
the  85  respondents  disagreed  or  strongly  disagreed;  24  percent  were  not  sure.  Staff 
members  who  do  not  know  where  the  Department  is  heading  cannot  help  effectively  to  get 
it  there. 

The  Department’s  changing  mission  statements  over  time  reflect  the  absence  of  a clear, 
compelling  vision.  Past  mission  statements  for  the  Department  referred  to  nearly  every 
function  the  Department  performs.  The  variations  in  its  mission  statements  indicate  the 
Department’s  management  has  been  unfocused.  The  Department  needs  a single,  clear 
statement  that  expresses  the  overall  purpose  for  its  existence.  Although  in  the  past  the 
Department  has  had  varying  mission  statements,  its  most  recent  mission  statement  from  its 
fiscal  year  2000-01  budget  is  more  appropriate:  “to  serve  and  protect  the  citizens  of  the 
City  and  County  of  San  Francisco  through  the  investigation  and  supervision  of  adult 
criminal  offenders.” 
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The  Department's  Goals  and  Objectives 
Need  Clarification  or  Restatement 

Although  the  Department  has  stated  several  goals  and  objectives,  these  need  revision  or 
reformulation  to  make  them  more  understandable  and  to  connect  them  directly  to  the 
Department’s  mandated  duties  and  mission.  Specifically,  the  Department’s  goals  and 
objectives  should  tie  to  its  mission  and  clarify  what  it  means  to  serve  and  protect  the 
citizens  of  San  Francisco.  More  than  half  of  85  respondents  to  the  employee  survey  agree 
that  the  Department  has  not  defined  its  goals  and  objectives  clearly.  Consequently, 
employees  do  not  know  how  to  fulfill  the  Department’s  mission. 

This  lack  of  specificity  and  connection  to  the  mission  statement  reflects  the  Department’s 
failure  to  engage  in  a structured  planning  process.  Without  an  overall  vision  and  a well- 
defined  mission,  the  Department  is  limited  in  its  ability  to  formulate  appropriate  goals  that 
identify  the  changes  or  results  that  the  Department  must  achieve  to  fulfill  its  vision  and 
carry  out  its  mission. 

In  addition,  the  Department’s  current  goals  and  objectives  indicate  that  it  misunderstands 
the  purpose  of  these  critical  elements  of  performance  management.  For  example,  the 
Department  has  confused  goals  with  objectives.  Further,  some  of  the  Department’s  goals 
tie  to  its  mission,  but  others  do  not.  In  the  budget  documents  and  annual  report  we 
reviewed,  we  found  a total  of  five  statements  listed  as  goals.  Of  those,  three  related  to  the 
Department’s  mission,  and  several  were  written  more  like  objectives  or  multiple 
objectives,  with  goals  implied. 

A goal  should  be  a simple  statement  of  something  the  Department  is  trying  to  achieve,  the 
desired  outcome  of  which  should  relate  directly  to  the  Department’s  mission.  An  objective 
should  be  a quantified,  measurable,  time-limited  statement  of  expected  results.  When  it 
achieves  the  objective,  the  Department  will  have  progressed  toward  a particular  goal.  One 
of  the  Department’s  current  goals — “to  increase  total  collections  of  fines,  fees,  and 
restitution” — is  appropriate  as  a goal,  but  it  does  not  include  an  accompanying  objective 
indicating  how  this  goal  is  to  be  achieved.  In  contrast,  the  Department’s  stated  goal  “to  re- 
structure the  probation  department  by  consolidation  and  reclassification  of  staff  positions, 
restructure  of  divisions  for  greater  efficiency  in  span  of  control,  to  reduce  the  caseload 
sizes,  to  eliminate  workload  duplications”  is  not  a goal.  Rather,  the  statement  is  a set  of 
objectives  aimed  at  the  implied  goal  of  improving  the  efficiency  of  the  Department  and 
enhancing  the  supervision  of  probationers.  Because  a goal  should  address  only  one  major 
function,  the  Department  could  better  state  the  goal  as  “to  improve  the  supervision  of 
probationers  through  increased  staff  productivity.”  Objectives  toward  achieving  this  goal 
could  include  the  Department’s  implementing  a reorganization  plan  by  a certain  date  and 
reclassifying  positions  by  a certain  date. 
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ADDITIONAL  PERFORMANCE  MEASURES 
WOULD  ALLOW  THE  DEPARTMENT 
TO  REPORT  MEANINGFUL  RESULTS 


Although  the  Department  generally  uses  a consistent  set  of  performance  measures  that 
relates  to  its  mission  and  goals,  it  should  establish  additional  measures.  Our  audit  revealed 
that  the  Department  has  improved  its  measures.  However,  to  allow  the  City,  the  Court,  and 
the  public  to  better  evaluate  its  performance,  the  Department  should  establish  new  outcome 
measures  that  gauge  the  effectiveness  of  its  programs  and  services.  Furthermore,  as 
discussed  in  Chapter  3,  the  Department  needs  to  improve  the  reliability  of  its  data  so  that 
the  results  it  reports  are  meaningful. 

A performance  measure  is  a quantitative  indicator  of  how  well  an  organization  is  fulfilling 
its  mission,  goals,  or  objectives.  Exhibit  17  at  the  beginning  of  this  chapter  describes  four 
types  of  measures:  input,  output,  efficiency,  and  outcome.  While  all  are  useful,  outcome 
measures  best  reflect  an  organization’s  effectiveness. 

Formerly  Inadequate  Performance 

Measures  Have  Improved 

Although  previous  budgets  included  some  inadequate  performance  measures,  the 
Department’s  most  recent  budgets  indicate  that  the  Department  is  beginning  to  connect  its 
measures  to  desired  results.  Many  of  the  Department’s  past  performance  measures  were 
weak  because  they  either  used  vague  wording  or  failed  to  specify  the  results  the 
Department  sought.  For  example,  in  fiscal  year  1997-98,  the  performance  measure  for  the 
Investigations  Division  was  the  number  of  reports  that  reach  Court  two  or  more  days 
before  sentencing.  The  measure  was  not  adequate,  however,  because  it  did  not  indicate  the 
quantity  of  timely  reports  that  the  Investigations  Division  should  produce.  Similarly,  in 
fiscal  year  1998-99,  the  Department  established  a performance  measure  to  increase  service 
delivery  to  female  probationers  and  female  and  juvenile  victims.  Not  only  did  this  measure 
fail  to  quantify  results,  it  also  neglected  to  define  “service  delivery.”  Thus,  it  was  too  vague 
for  the  Department  to  measure. 

In  contrast,  the  Department’s  fiscal  year  1999-2000  budget  contained  three  clearly  worded 
performance  measures:  the  percentage  of  presentence  reports  delivered  on  time  to  the 
Court,  the  average  number  of  active  cases  handled  per  probation  officer,  and  the  desired 
increases  in  collections  of  court  fees,  court-imposed  fines,  and  victim  restitution  money 
from  probationers.  Additionally,  this  budget  for  the  first  time  reported  actual  results  of  the 
measures  for  fiscal  year  1997-98,  projected  results  for  fiscal  year  1998-99,  and  targeted 
results  for  fiscal  year  1999-2000.  In  its  most  recent  budget  for  fiscal  year  2000-01,  the 
Department  again  reported  its  measures  for  presentence  reports  and  collections,  and  the 
budget  showed  actual,  projected,  and  targeted  results.  The  Department  also  provided  a 
measure  for  the  number  of  cases  probation  officers  handled;  however,  the  Mayor’s  Office, 
which  publishes  the  budget,  did  not  include  this  measure  in  the  budget. 
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Performance  Measures  Should  Also 
Address  Program  and  Policy  Outcomes 

To  further  improve  its  ability  to  report  meaningful  results,  the  Department  should  use 
performance  measures  that  assess  the  outcomes  of  Department  programs  and  services 
rather  than  simply  inputs,  or  resources  used,  and  outputs,  or  activities  performed.  Outcome 
measures  would  allow  the  Department  as  well  as  the  City,  the  Court,  and  the  public  to 
evaluate  the  effectiveness  of  departmental  activities. 

For  example,  the  number  of  cases  handled  per  probation  officer  is  an  output  measure  that  is 
useful  in  monitoring  workload,  but  this  measure  provides  no  information  about  whether  the 
Department’s  efforts  are  helping  to  rehabilitate  probationers  or  deterring  these  individuals 
from  committing  new  crimes.  Likewise,  while  the  percentage  of  presentence  reports 
submitted  on  time  to  the  Court  by  the  Investigations  Division  is  an  important  output 
measure,  this  aspect  of  the  division’s  performance  does  not  tell  the  Department  whether  the 
reports  serve  their  intended  purpose,  which  is  to  assist  judges  in  their  sentencing  decisions. 
An  outcome  measure  to  complement  the  timeliness  measure  could  present  the  percentage 
of  judges  who  rate  the  quality  of  presentence  reports  as  “good”  or  “very  good.” 

We  formulated  examples  of  other  outcome  measures  that  the  Department  could  consider 
adopting  and  reporting  on  in  the  future.  These  measures  center  on  the  Department’s 
calculating  the  following: 

• The  percentage  of  probationers  who,  within  12  months  of  successfully  completing 
probation,  do  not  reoffend. 

• The  percentage  of  probationers  receiving  job  training  or  employment  counseling  who 
successfully  obtain  and  retain  employment  during  their  probation. 

• The  percentage  of  probationers  convicted  of  drug  offenses  who  remain  drug  free  within 
six  months  of  completing  court-ordered  substance  abuse  programs. 

• The  percentage  of  total  fines,  fees,  and  restitution  due  that  the  Department  collects. 

• The  percentage  of  restitution  owed  that  victims,  in  fact,  receive. 

To  Be  Meaningful,  Reported  Results 
Should  Be  Accurate 

We  reviewed  the  results  of  performance  measures  the  Department  reported  in  its  two  most 
recent  budgets  and  found  inaccuracies  in  the  data  that  diminish  the  value  of  the  measures. 
As  Chapter  3 of  this  report  discusses,  the  statistics  the  Investigations  Division  produces  on 
the  percentage  of  presentence  reports  it  delivers  on  time  to  the  Court  are  not  reliable. 
Although  our  data  matched  the  result  the  Department  reported  for  this  measure  in  its  fiscal 
year  2000-01  budget,  our  result  for  the  prior  fiscal  year  showed  the  Department’s  data 
overstated  its  percentage  of  on-time  reports  by  9 percent.  Similarly,  Chapter  1 describes  the 
flaws  in  the  Department’s  process  for  tracking  its  number  of  probation  cases.  As  a result. 


CONTROLLER’S  AUDITS  DIVISION 


53 


the  data  the  Department  reports  on  the  average  number  of  cases  handled  per  probation 
officer  are  not  reliable.  On  the  other  hand,  the  Department’s  accounting  system  does 
provide  a reliable  source  of  information  on  collections.  We  confirmed  that  the  collection 
results  the  Department  reported  in  its  most  recent  budget  were  accurate. 

Without  accurate  data,  efforts  the  Department  makes  toward  managing  its  workload  and 
improving  the  productivity  and  efficiency  of  its  staff  may  be  misguided.  Further,  to  the . 
extent  that  the  budget  process  uses  performance  measures,  inaccurate  results  could  have  an 
adverse  impact  on  allocation  of  resources  to  the  Department.  Chapter  3 indicates  the 
Investigations  Division  plans  to  implement  a new  database,  which  will  improve  its  ability 
to  produce  accurate  statistics  about  the  reports  it  produces. 


THE  DEPARTMENT  NEEDS  TO  REVISE 
ITS  REPORTING  FUNCTIONS  TO 
ENSURE  ITS  MANAGEMENT  DECISIONS 
ARE  WELL  INFORMED 

Although  the  Department  has  consistently  included  performance  measures  in  its  annual 
budget  as  required,  its  process  for  reporting  and  using  performance  data  internally  is  weak. 
The  Department  also  did  not  comply  with  the  Administrative  Code  requirement  to  issue  an 
annual  report  on  its  operations. 

Senior  Management  Does  Not  Use  Data 
Effectively  as  a Management  Tool 

According  to  the  chief  adult  probation  officer,  he  does  not  regularly  use  or  rely  on  internal 
reports  or  data  in  overseeing  the  Department’s  operations.  Data  on  operations  should  be  the 
foundation  for  the  Department’s  assessment  of  whether  its  policies,  plans,  and  programs 
are  working.  By  comparing  data  over  time,  senior  management  can  reinforce  successes  and 
identify  problems  or  opportunities  when  they  arise.  Comparative  statistics  provide 
quantitative,  fact-based  information  for  decision  making. 

Under  the  previous  chief  and  for  about  a year  of  the  current  chiefs  tenure,  senior  managers 
were  required  to  report  monthly  statistics  on  the  activities  under  their  direction.  By 
December  1998,  however,  the  current  chief  stated  that  he  had  ceased  to  ask  for  most 
regularly  scheduled  reports,  receiving  only  monthly  reports  about  total  collections.  The 
chief  explained  to  us  that  he  did  not  feel  that  compiling  reports  made  effective  use  of  his 
staffs  time  and  that  he  could  ask  for  information  if  he  needed  it.  As  a result,  the  chief  does 
not  regularly  receive  adequate  management  information  on  the  Department’s  primary 
activity — the  supervision  of  probationers. 

Further,  for  several  months  in  1999,  the  Department’s  senior  cashier  compiled  and 
distributed  to  senior  managers  data  on  the  number  of  open  cases  that  owed  money  but  that 
had  unusable  addresses.  However,  according  to  the  cashier,  no  one  showed  interest  in  the 
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report,  so  she  stopped  producing  it.  Chapter  2 points  out  that  incorrect  addresses  could  be 
costing  the  Department  $55,000  or  more  per  year.  In  this  case  senior  management  did  not 
use  the  information  on  bad  addresses  to  identify  and  develop  an  approach  to  solving  this 
problem. 

The  preceding  chapters  describe  other  serious  ramifications  of  senior  management’s 
limited  efforts  to  evaluate  and  report  on  the  Department’s  work.  These  consequences 
include  lax  supervision  of  probationers,  poor  morale  among  probation  officers,  and  the 
Department’s  inability  to  plan  effectively.  Senior  management  is  unable  to  track  the 
Department’s  performance  or  isolate  the  sources  of  problems  that  arise.  Moreover,  without 
regular  information  about  the  Department’s  operations,  senior  management  increases  its 
chances  of  failing  to  notice  issues  until  they  are  crises  and  of  making  inappropriate  or 
ineffective  decisions  about  departmental  activities. 

The  Department  Has  Not  Issued  an 

Annual  Report  Since  Its  Report  for  Fiscal 

Year  1995-96 

Not  only  is  the  Department  ineffectively  using  internal  reporting,  it  has  not  submitted  an 
annual  report  to  the  Board  of  Supervisors  since  its  report  covering  fiscal  year  1995-96.  In 
January  1999,  the  chief  stated  that  he  was  revising  the  report  format  because  he  felt  the 
annual  reports  produced  under  the  previous  chief  did  not  adequately  reflect  the 
Department’s  operations.  He  expected  to  issue  a report  on  fiscal  year  1998-99  activities  in 
the  summer  of  1999;  however,  as  of  June  30,  2000,  no  report  had  been  issued. 

Preparing  an  annual  report  provides  a forum  for  the  Department  to  consider  its 
accomplishments  in  relation  to  its  mission  and  goals  for  the  previous  year.  The  process  can 
also  assist  the  Department  in  planning  for  subsequent  years.  Not  publishing  an  annual 
report  is  a default  on  a requirement  of  the  Administrative  Code,  and  also  means  that  the 
Department  loses  a significant  opportunity  to  present  its  accomplishments  to  the  City,  the 
Court,  the  public,  and  the  Department’s  own  staff. 


RECOMMENDATIONS 

To  improve  the  effectiveness  of  its  operations  and  ensure  that  it  complies  with  Charter  and 
Administrative  Code  requirements,  the  Adult  Probation  Department  should  do  the 
following: 

• Undertake  a strategic  planning  process  that  will  result  in  vision  and  mission  statements 
for  the  Department  as  well  as  a comprehensive  set  of  clearly  worded  goals  and 
objectives  that  relate  directly  to  the  vision  and  mission.  The  Department  could  use  its 
existing  task  force  as  a basis  for  creating  a formal,  structured  strategic  planning  body 
charged  with  preparing  a three-year,  forward  looking  plan,  as  the  Administrative  Code 
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requires.  The  Department  should  consider  engaging  an  outside  party,  such  as  the  City’s 
Department  of  Human  Resources,  to  facilitate  the  planning  process  and  train 
participants  in  the  elements  of  strategic  planning. 

• Communicate  to  all  staff  the  results  of  the  strategic  planning  process,  including  the 
vision,  mission,  goals,  and  objectives  adopted. 

• Develop  and  use  performance  measures  that  address  the  Department’s  policy  and 
program  outcomes  in  addition  to  the  quantity  of  resources  used  and  work  completed. 

At  a minimum,  the  performance  measures  in  the  Department’s  budget  submission  for 
fiscal  year  2001-02  should  include  at  least  one  outcome  measure. 

• Monitor  and  report  accomplishments  in  terms  of  established  performance  measures. 
Management  should  present  performance  measure  results  in  the  Department’s  budget 
and  annual  report  so  that  department  staff,  city  policy  makers,  and  the  Court  can  see  the 
Department’s  success  in  achieving  its  objectives. 

• Compile  and  analyze  data  on  the  Department’s  key  operational  and  strategic  issues, 
including  supervision  of  probationers,  collection  of  fines  and  fees,  and  preparation  of 
reports  for  the  Court,  to  track  performance  in  these  areas.  Senior  management  should 
receive  and  review  summary  reports  regularly  and  use  the  data  to  inform  its 
management  decisions.  Reports  should  display  the  information  in  ways  that  facilitate 
identification  of  trends. 

• Issue  an  annual  report  for  the  1999-2000  fiscal  year  and  continue  publishing  such 
reports  in  future  years. 
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CHAPTER  5 

LACK  OF  OVERSIGHT  AND  WEAK  MANAGEMENT  CONTROLS 
EXPOSE  THE  PUBLIC,  THE  CITY,  AND  THE  SUPERIOR  COURT 
TO  UNNECESSARY  RISK 


CHAPTER  SUMMARY 

The  State  of  California  Superior  Court  for  the  County  of  San  Francisco  (Court), 
which  appoints  the  chief  adult  probation  officer,  does  not  adequately  oversee  the 
Adult  Probation  Department  (Department).  Additionally,  the  City  and  County  of 
San  Francisco  (City),  which  funds  the  Department,  lacks  sufficient  authority  over  the 
Department  to  give  it  effective  guidance.  Moreover,  as  the  preceding  chapters  of  this  report 
illustrate,  the  Department  does  not  have  a coherent  system  of  policies  and  procedures  to 
ensure  that  it  fulfills  its  mission  and  achieves  its  desired  results.  This  absence  of 
management  controls  exposes  the  Department,  the  City,  and  the  Court  to  an  array  of  risks, 
including  inadequately  supervised  probationers  and  poor  allocation  of  resources. 

Specifically,  the  Department  has  a weak  system  for  ensuring  that  probation  officers 
supervise  probationers  adequately,  and  it  has  not  addressed  deficiencies  in  its  procedures 
for  evaluating  the  threat  probationers  pose  to  the  safety  of  staff  and  the  public.  Because  the 
Department  classifies  35  percent  of  its  probation  cases  as  posing  maximum  risk  to  the 
public,  the  potential  effects  of  such  weak  controls  could  be  severe.  In  addition  to  the  weak 
procedures  related  to  supervision  of  probationers,  other  out-of-date  and  unenforced  policies 
and  procedures — or  the  absence  of  them — have  resulted  in  lost  revenues  and  staff  time  and 
have  increased  the  possibility  that  the  Department  is  using  its  resources  ineffectively.  The 
Department’s  inconsistent  evaluation  of  employee  performance  weakens  the  accountability 
of  staff. 

The  Court’s  minimal  oversight  of  the  Department  has  allowed  the  Department  to  continue 
its  operations  without  addressing  serious  risks  that  may  jeopardize  public  safety  and  the 
success  of  the  Department.  To  improve  the  Department’s  accountability,  the  City  could 
change  the  way  the  chief  adult  probation  officer  is  appointed  to  give  the  City  greater 
control  over  the  Department. 


BACKGROUND 

A management  control  system  consists  of  policies,  procedures,  techniques,  and  processes 
that  enable  an  organization  to  meet  its  goals  and  objectives  and  to  address  risks  when  they 
materialize.  The  United  States  General  Accounting  Office  explains  in  Standards  for 
Internal  Controls  in  the  Federal  Government  (November  1999,  p.  4)  that  a management 
control  system  “comprises  the  plans,  methods,  and  procedures  used  to  meet  missions, 
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goals,  and  objectives  and,  in  doing  so,  supports  performance-based  management.  Internal 
control  also  serves  as  the  first  line  of  defense  in  safeguarding  assets  and  preventing  and 
detecting  errors  and  fraud.” 

External  oversight  is  critical  to  management  control  as  it  gives  direction  and  holds  an 
organization  accountable  for  program  performance.  Without  external  guidance, 
organization  leaders  must  manage  in  a vacuum,  with  little  demand  to  produce  measurable 
results. 

Risk  assessment  is  another  important  element  of  management  control.  It  is  the  process  of 
identifying  internal  and  external  challenges  that  may  impede  an  organization  from 
accomplishing  its  mission.  Management  has  the  responsibility  to  evaluate  risks  for  their 
likelihood  and  possible  consequences.  Management  also  must  decide  how  to  prevent  risks 
from  materializing  and  how  to  mitigate  damage  when  they  do.  Based  on  these  decisions, 
managers  develop  controls,  including  policies  and  procedures,  physical  controls  (such  as 
doors  and  locks),  segregation  of  duties,  and  other  tools  for  controlling  risk.  For  example, 
the  Department  recently  created  a procedure  for  handling  disruptive  behavior  by 
probationers  when  they  are  in  the  Department’s  offices. 

Exhibit  1 8 illustrates  the  relationships  among  management  controls,  assessments  of  risk, 
and  the  achievement  of  results. 


Exhibit  18  The  Role  of  Management  Controls  in  Producing  Results 


External  Oversight 


► 


Internal  & External 
Risks  Threaten 
Goals  and  Objectives 


A weak  system  of  management  control  reduces  the  likelihood  that  an  organization  will 
achieve  its  desired  results.  In  this  situation,  managers  operate  without  well-organized 
information  about  the  organization’s  activities  and  with  incomplete  systems  for  controlling 
staff  activities.  Moreover,  the  organization  is  not  prepared  to  identify  and  address  risks  that 
arise,  further  jeopardizing  the  organization’s  ability  to  fulfill  its  mission.  Many  of  the 
findings  identified  in  the  preceding  chapters  result  from  weak  management  controls  or  the 
absence  of  such  controls.  In  its  fiscal  year  2000-01  budget,  the  Department  received 
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approval  to  hire  a principal  administrative  analyst,  who  could  assist  the  Department  in 
strengthening  its  system  of  management  controls. 


OVERSIGHT  OF  THE  DEPARTMENT  IS  INADEQUATE 


The  City  funds  the  Department,  but  the  Court  supervises  it.  Because  neither  offers  specific 
direction  to  the  Department,  management  at  the  Department  lacks  accountability  to  an 
outside  authority.  Neither  the  City  nor  the  Court  requires  the  Department  to  produce 
specific  results,  so  management  does  not  focus  on  the  expectations  of  either  the  Court  or 
the  City.  Without  effective  external  supervision  and  the  systematic  review  of  performance 
that  accompanies  it,  the  Department  may  not  deploy  its  resources  in  a way  that  is 
consistent  with  City  or  Court  policy. 

In  accordance  with  the  City  and  County  of  San  Francisco  Charter  (Charter)  and  state  law,  a 
majority  of  the  judges  of  the  Court  appoints  the  chief  adult  probation  officer.  The  presiding 
judge  of  the  Court  has  delegated  ongoing  oversight  of  the  Department  to  the  presiding 
judge  of  the  Court’s  criminal  division  (presiding  judge).  The  San  Francisco  Board  of 
Supervisors  (Board)  funds  the  Department’s  operations  and  approves  staffing  levels; 
however,  the  extent  of  the  Board’s  authority  is  largely  budgetary.  Exhibit  19  illustrates  the 
relationships  between  the  Department,  the  City,  and  the  Court. 

Exhibit  1 9 Weak  Accountability  in  the  Current  Structure  for 
Oversight  of  the  Adult  Probation  Department 


State 

Superior 

Court 


City 

Board  of 
Supervisors 


The  Court  Provides  Minimal 
Oversight  of  the  Department 

Although  the  Court  and  Department  staff  have  periodic  contact,  the  Court  does  not  actively 
guide  the  Department.  The  Court’s  oversight  of  the  Department  includes  brown  bag 
lunches  to  which  the  chief  adult  probation  officer  may  be  invited  approximately  every  two 
months  to  discuss  specific  issues.  Both  the  presiding  judge  of  the  Court  and  the  presiding 
judge  of  the  criminal  division  stated  they  do  not  keep  minutes  or  notes  of  these  meetings. 
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The  presiding  judge’s  annual  review  of  the  chief  adult  probation  officer’s  performance  is 
the  only  written  documentation  related  to  the  Court’s  oversight  of  the  Department  noted  by 
the  two  judges  or  the  chief  adult  probation  officer. 

The  City  Could  Change  the  Charter  to 
Increase  Its  Control  Over  the  Department 

To  provide  greater  control  over  the  Department  and  improve  the  Department’s 
accountability  to  the  City,  the  City  could,  under  the  state  constitution,  change  the  way  the 
chief  adult  probation  officer  is  appointed.  The  California  constitution  provides  that  a city 
and  county  with  a charter,  such  as  San  Francisco,  may  enact  provisions  that  take 
precedence  over  the  State’s  general  law  provisions  intended  for  counties  without  charters. 
Thus,  any  charter  county  can  supersede  Section  1203.6  of  the  California  Penal  Code  (Penal 
Code),  which  requires  the  Court  to  appoint  the  chief  adult  probation  officer.  In  other 
words,  a City  entity  (such  as  the  Board  or  the  Mayor),  rather  than  the  Court,  could  appoint 
the  chief  adult  probation  officer. 

A number  of  factors  support  a change  in  San  Francisco’s  appointment  structure.  Among 
them  is  the  City’s  strong  stake  in  promoting  positive  probation  outcomes.  The  City  has 
compelling  financial  and  political  incentives  for  ensuring  that  probationers  receive 
effective  supervision.  To  the  extent  that  it  can  encourage  probationers’  rehabilitation  and 
decrease  their  propensity  to  commit  new  crimes,  the  Department  can  play  an  important  role 
in  reducing  the  burden  on  the  City’s  social  service  and  criminal  justice  systems.  Resulting 
improvements  in  public  safety  would  reflect  well  on  elected  officials  and  make  the  City  a 
more  attractive  place  to  live,  work,  and  visit. 

In  contrast  to  the  City’s  financial  incentives,  the  Court,  which  is  a State  of  California 
(State)  entity,  has  no  financial  incentive  to  improve  administration  of  the  Department. 
Furthermore,  oversight  of  the  Department’s  operations  is  the  responsibility  of  the  presiding 
judge  who  is  elected  by  the  judges  of  the  Court  for  a one-year  term  and  is  not  a permanent 
administrator. 

San  Francisco  could  follow  the  examples  set  by  the  counties  of  Los  Angeles  and  San 
Diego,  which  are  charter  counties  that  have  opted  to  supersede  the  Penal  Code  provision. 
Los  Angeles  County  provides  for  appointment  of  the  head  of  the  probation  department  by 
the  county  board  of  supervisors.  In  San  Diego  County,  the  chief  adult  probation  officer  is 
appointed  by  the  county  board  of  supervisors  and  confirmed  by  a majority  of  Superior 
Court  judges.  Changing  San  Francisco’s  structure  for  appointing  the  chief  adult  probation 
officer  would  necessitate  an  amendment  to  the  Charter,  which  requires  the  approval  of  a 
majority  of  San  Francisco  voters. 

The  City  could  administer  the  Department  in  one  of  a number  of  ways.  For  example,  the 
chief  adult  probation  officer  could  be  appointed  by  the  mayor  and  report  to  a commission, 
as  does  the  chief  probation  officer  of  the  Juvenile  Probation  Department.  Or,  the  chief  adult 
probation  officer  could  report  directly  to  the  mayor,  as  do  heads  of  several  departments.  If 
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the  City  followed  the  Los  Angeles  model,  the  chief  adult  probation  officer  could  be 
appointed  by  the  Board  and  could  report  to  a department  head. 

Such  an  arrangement  has  the  potential  to  provide  a stronger  oversight  structure  for  the 
Department  than  under  the  current  system,  with  funding  authority,  appointment  authority, 
and  external  oversight  all  under  the  control  of  the  City  and  County  of  San  Francisco. 
Shifting  the  appointment  authority  of  the  chief  adult  probation  officer  from  the  state 
Superior  Court  to  the  City  would  allow  the  City  to  hold  the  chief  adult  probation  officer 
and  the  Department  accountable  for  the  adequate  supervision  of  probationers  and  for  the 
effective  use  of  the  Department’s  resources. 


THE  ABSENCE  OF  AN  EFFECTIVE  RISK-ASSESSMENT 
PROCESS  COULD  JEOPARDIZE  PUBLIC  SAFETY  AND 
DEPARTMENT  RESOURCES 

The  Department  lacks  a process  for  systematically  assessing  the  risks  it  faces.  This 
omission  could  jeopardize  public  safety  and  negatively  affect  the  Department’s  ability  to 
achieve  its  desired  results  and  possibly  expose  the  City  to  legal  liability.  Risks  challenging 
the  Department  include  the  potential  that  a probationer  will  not  receive  the  appropriate 
degree  of  supervision  and  threaten  public  safety,  that  the  Department  may  use  scarce 
resources  ineffectively,  or  that  it  may  forego  revenues  because  staff  does  not  follow 
procedures.  The  Department  has  not  developed  a comprehensive,  effective  set  of  policies, 
procedures,  and  techniques  to  prevent  these  hazards  from  materializing. 

The  Department  Does  Not  Adequately 
Manage  Its  Process  for  Assessing  the 
Risks  That  Probationers  Pose 

The  Department  uses  a scoring  process  to  assess  the  risk  that  probationers  pose  to  the 
public.  The  chief  adult  probation  officer  stated  that  the  Department  is  not  enforcing  its 
policy  for  reassessing  periodically  a probationer’s  risk.  Therefore,  a probationer’s  risk 
score  may  not  accurately  reflect  his  or  her  potential  threat  to  public  safety,  and  the 
Department  may  be  providing  an  inappropriate  level  of  supervision. 

The  Department  uses  a probationer’s  risk  score  to  determine  the  intensity  of  supervision 
warranted.  Our  interviews  with  senior  managers  revealed  that  probation  officers  do  not 
fully  understand  the  method  of  scoring  probationer  risk.  The  Department  acknowledged  as 
early  as  June  1 998  that  training  was  necessary  to  ensure  consistent,  adequate  application  of 
the  scoring  tool.  However,  the  Department  did  not  provide  training  until  the  second  quarter 
of  2000. 

Furthermore,  two  Department  policies  regarding  how  to  identify  maximum-risk  cases 
contain  conflicting  information.  The  Department’s  policy  on  classifying  new  probationers 
categorizes  probationers  with  risk  scores  of  more  than  1 6 points  as  maximum  risk.  On  the 
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other  hand,  the  Department’s  policy  on  transferring  probation  cases  between  caseloads 
considers  probationers  scoring  23  or  more  points  as  maximum  risk.  Although  the  policy  on 
classifying  new  probationers  is  dated  June  1983  and  the  policy  on  transferring  cases  is 
dated  October  1990,  these  are  both  formal  procedures  published  in  the  Department’s  policy 
and  procedure  manual.  In  practice,  the  Department  uses  a score  of  23  or  more  to  denote 
maximum-risk  cases.  Such  discrepancies  among  policies  and  between  policy  and  practice 
underscore  the  potential  that  the  Department  will  classify  a probationer  at  a level  that  does 
not  reflect  actual  risk,  whether  high  or  low. 

Our  review  also  revealed  that  the  Department  is  not  reassessing  the  risk  levels  of 
probationers  during  their  terms  of  probation.  Department  policy  requires  probation  officers 
to  reassess  a probationer’s  risk  level  after  the  first  six  months  of  probation  and  then  yearly, 
unless  some  other  event  triggers  a reassessment.  As  a result,  a probationer’s  risk  level 
could  increase  or  decline  without  the  knowledge  of  the  Department.  Should  a probationer’s 
risk  level  increase  without  a corresponding  increase  in  probationer  supervision,  the 
probationer  could  threaten  the  public’s  safety.  If  the  risk  level  improves  without  the 
Department’s  knowledge,  the  Department  would  be  devoting  resources  to  a higher  level  of 
supervision  than  is  warranted.  The  Department  could  instead  use  those  resources  to 
supervise  probationers  who  are  more  dangerous. 

The  Department  Has  a Weak  System  for 

Ensuring  That  Probation  Officers 

Supervise  Cases  Adequately 

Probationers  may  also  receive  an  inappropriate  level  of  supervision  because  the 
Department  lacks  a system  that  evaluates  whether  probation  officers  give  probationers  the 
attention  required.  As  Chapter  1 points  out,  the  Department  has — but  does  not  enforce — a 
policy  requiring  unit  supervisors  to  conduct  random  reviews  of  probation  case  files,  which 
is  a process  that  could  reduce  the  possibility  that  cases  go  unsupervised. 

Evidence  gathered  during  our  case  file  review  and  the  results  of  our  survey  of  Department 
employees  indicate  that  at  least  some  probation  officers  leave  cases  unsupervised. 

Probation  officers  indicated  that  higher-priority  tasks,  such  as  preparing  reports  for  the 
Court  or  dealing  with  more  difficult  probationers,  keep  the  officers  from  actively 
supervising  some  probationers. 

The  City  could  bear  legal  responsibility  for  the  Department’s  inadequate  supervision  of 
probationers.  In  1999,  the  Supreme  Court  for  the  State  of  Washington  found  King  County 
and  the  City  of  Seattle  liable  for  their  failure  to  properly  monitor  a probationer  who 
committed  a serious  crime  while  on  probation. 

The  chief  adult  probation  officer  stated  in  August  1999  that  he  recognized  the  risk  in  the 
practice  of  allowing  cases  to  go  unsupervised  through  unofficial  banking  and  planned  to 
issue  a policy  to  clarify  the  Department’s  position.  However,  he  did  not  issue  the  policy 
until  June  30,  2000. 
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Inattention  to  Risks  Threatens 
Department  Resources 

Lack  of  a systematic  approach  to  identifying  and  addressing  risks  related  to  probationers 
and  their  obligations  can  also  result  in  lost  revenue  and  inefficient  use  of  department 
resources.  For  example,  as  Chapter  2 explains,  the  Department’s  failure  to  focus  on  risks 
associated  with  its  collection  of  probationer  fines  and  fees  has  cost  it  potentially  significant 
amounts  of  money.  Informing  the  cashier’s  office  of  a probationer’s  court-ordered  fines 
and  fees  is  a prerequisite  to  collecting  on  that  account.  Nevertheless,  the  Department  has  no 
system  for  ensuring  that  the  cashier’s  office  receives  information  on  all  the  probationers 
that  it  should.  As  a result,  financial  obligations  for  thousands  of  probation  cases  are 
missing  from  the  accounting  system,  and  could  be  costing  the  Department  as  much  as 
$360,000  annually. 

The  new  case  filing  system  the  Department  is  implementing  offers  another  example  of  an 
unsystematic  approach  to  risk.  As  mentioned  in  Chapter  1,  the  system  will  help  reduce  lost 
and  duplicate  files  by  replacing  the  current  method  of  storing  documents  in  file  cabinets 
with  an  automated  system  capable  of  tracking  the  movement  of  files.  The  success  of  the 
new  system,  which  requires  staff  to  scan  a file’s  bar  code  every  time  the  file  moves  to  a 
new  location,  will  depend  upon  the  system’s  proper  and  consistent  use  by  Department 
staff.  The  Department  is  taking  the  important  first  step  and  writing  policies  and  procedures 
for  the  new  system.  However,  these  policies  and  procedures  will  be  effective  only  to  the 
extent  that  management  enforces  and  staff  follows  these  directives.  The  manager  who 
supervises  case  filing  pointed  out  that  some  problems  with  the  current  filing  system  exist 
because  staff  does  not  follow  the  established  procedures.  The  new  system  is  at  risk  of 
failure  if  senior  management  does  not  support  the  system  with  the  proper  controls  to  ensure 
its  correct  use.  If  the  system  fails,  the  department  will  have  gained  little  from  the  more  than 
$50,000  plus  staff  time  spent  on  it. 


THE  DEPARTMENT’S  POLICIES  AND  PROCEDURES 
ARE  NOT  SUFFICIENTLY  AUTHORITATIVE  OR 
CURRENT  TO  SERVE  AS  EFFECTIVE 
MANAGEMENT  CONTROLS 

The  Department’s  policy  and  procedure  manual  is  significantly  out  of  date  and  is  not 
serving  as  an  essential  reference  for  managers  and  staff.  The  chief  adult  probation  officer 
has  recognized  that  the  Department’s  policies  and  procedures  need  substantial 
improvement.  According  to  the  chief,  a task  force  subcommittee,  formed  in  the  spring  of 
2000,  has  been  charged  with  updating  the  manual. 

An  organization’s  manual  should  act  as  a management  control  to  ensure  that  employees 
carry  out  their  organization’s  activities.  A policy  and  procedure  manual  is  also  a tool  for 
guiding  employees  in  attaining  their  organization’s  goals  and  objectives  and  in  fulfilling 
the  organization’s  mission.  As  Chapter  4 discusses,  the  Department’s  mission,  goals,  and 
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objectives  need  improvement.  If  these  elements  are  first  in  place,  policies  and  procedures 
can  be  a powerful  way  to  focus  the  Department’s  staff  and  its  operating  systems  on 
achieving  its  mission,  goals,  and  objectives. 

The  Department’s  Policy  and  Procedure 
Manual  Is  Not  a Definitive  Source  of 
Information 

The  policy  and  procedure  manual  should  reflect  legal  developments  in  the  field  of 
probation  and  in  administrative  areas,  such  as  personnel.  The  manual  should  also  contain 
the  Department’s  approved  processes  to  achieve  current  goals  and  objectives.  Without  a 
manual  that  is  both  legally  and  procedurally  up  to  date,  employees  are  sometimes  left  to 
their  own  devices  to  research  current  law  or  procedure  or  to  determine  how  best  to  proceed, 
consistent  with  their  own  understanding  of  the  Department’s  goals  and  objectives. 
According  to  one  writer,  all  or  parts  of  a manual  become  obsolete  within  three  to  six  years. 
In  a department  that  considers  35  percent  of  its  probationers  to  pose  maximum  risk  to  the 
public,  the  consequences  of  a lack  of  authoritative  policies  and  procedures  is  more  critical 
than  in  a department  with  a more  benign  clientele. 

Interviews  with  members  of  the  management  team  indicate  that  the  policy  and  procedure 
manual  is  not  considered  an  authoritative,  primary  source  of  information  on  Department 
functions.  In  fact,  the  chief  adult  probation  officer  stated  that  the  manual  only  reflected  35 
to  40  percent  of  the  Department’s  actual  operations. 

Management  does  not  formally  issue  or  include  in  the  manual  all  policies  and  procedures. 
For  example,  both  the  chief  adult  probation  officer’s  executive  secretary  and  the  business 
manager  stated  that  the  chief  adult  probation  officer  orally  communicated  a policy  limiting 
the  number  of  fee  and  fine  waivers  to  be  approved  by  unit  supervisors.  Similarly,  the  chief 
adult  probation  officer  issued  a disaster  preparedness  procedure  as  a memorandum  and  did 
not  incorporate  the  procedure  in  the  manual.  Further,  a division  director  stated  that  some 
formal  policies  and  procedures  are  no  longer  relevant,  such  as  those  for  work  furlough  and 
home  detention,  and  others  are  only  partially  relevant. 

As  of  May  2000,  the  current  chief  adult  probation  officer  had  issued  10  new  policies  and 
procedures  (out  of  83  on  file)  since  his  arrival  in  August  1997.  The  policies  and  procedures 
the  chief  adult  probation  officer  has  issued  address  critical  concerns.  However,  as  Exhibit 
20  shows,  senior  managers  have  not  kept  current  the  majority  of  policies  and  procedures 
affecting  the  Department’s  daily  operations. 

Most  Policies  and  Procedures 
Are  More  Than  Ten  Years  Old 

Many  of  the  Department’s  written  policies  and  procedures  are  unauthoritative  because  they 
are  outdated,  and,  as  a result,  the  Department  is  vulnerable  to  making  inappropriate 
decisions.  As  of  May  2000,  the  Department  had  issued  or  revised  only  12  percent  of  its 
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policies  and  procedures  since  1995.  Only  35  percent  of  the  policies  and  procedures  have 
been  issued  or  revised  since  1985.  Exhibit  20  shows  the  age  of  the  Department’s  policies 
and  procedures  in  the  manual  we  reviewed. 


The  effects  of  outdated  policies  and  procedures  can  be  significant  because  managers  may 
lose  credibility  among  staff  if  they  do  not  have  an  authoritative  source  for  their  decisions, 
staff  may  waste  time  trying  to  determine  proper  procedures  and  rely  on  other  staff  or  other 
sources  of  information,  and  the  Department  could  make  inappropriate  decisions  that  result 
in  misdirected  efforts.  For  example,  according  to  a division  director,  one  policy  and 
procedure  related  to  probation  costs  and  fees  is  out  of  date  and  could  result  in  court  reports 
containing  erroneous  information. 


The  Absence  of  Policies  and  Procedures 
Results  in  Lost  Staff  Time  and 
Uncollected  Revenue 


Staff  members  have  spent  considerable  time  trying  to  develop  policies  and  procedures  that 
have  not  materialized.  For  example,  a series  of  documents  provided  to  the  audit  team  by 
the  chief  adult  probation  officer  documents  the  cashiers  office’s  attempt,  over  more  than 
two  years,  to  receive  from  management  a comprehensive  policy  on  allotting  collected 
funds  among  various  accounts.  The  effort  began  in  fall  1997  and  had  not  yet  resulted  in  a 
new  policy  as  of  June  2000.  Failure  to  set  this  policy  means  that  the  cashier’s  office  must 
establish  its  own  methods  to  allot  to  various  accounts  more  than  $900,000  annually  in 
payments  not  related  to  restitution,  including  state  fines  and  fees  and  expenses  of 
probation. 

The  lack  of  current,  written  policies  and  procedures  can  also  cost  the  Department  money 
when  staff  members  depart  and  the  memory  of  a particular  process  is  lost.  For  example,  as 
Chapter  2 describes,  the  Department  discontinued  a collection  process  involving  the 
Franchise  Tax  Board  when  the  Department  changed  business  managers  in  January  1998. 
The  elimination  of  this  process  resulted  in  a loss  to  the  Department  of  between  $25,000 
and  $30,000  per  year.  This  occurred  even  though  the  Department  has  identified  for  several 
years  increasing  collections  as  a strategic  or  budget  issue.  Had  there  been  a policy  and 
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procedure  requiring  that  this  collection  process  be  carried  out,  it  is  unlikely  that  it  would 
have  ceased  without  management’s  knowledge. 

This  and  preceding  chapters  of  this  report  contain  other  examples  of  the  effects  of  the 
Department’s  policies  and  procedures  that  are  confusing  or  out  of  date,  the  staffs  failure  to 
follow  policies  and  procedures  consistently,  and  situations  in  which  the  Department  has  not 
established  policies  and  procedures. 


PERFORMANCE  APPRAISALS  OF  EMPLOYEES 
OCCUR  INFREQUENTLY  RESULTING  IN  LACK 
OF  ACCOUNTABILITY 

Not  only  has  the  Department  neglected  to  keep  its  policies  and  procedures  current,  it  has 
not  used  the  City’s  performance  appraisal  process  consistently.  According  to  Department 
of  Human  Resources  documentation,  the  City’s  performance  appraisal  process  should  be 
administered  in  a yearly  cycle.  In  a test  of  32  personnel  files,  representing  24  percent  of  the 
total  staff,  we  found  that  only  seven  (21  percent)  of  these  files  contained  performance 
appraisals  dated  within  the  last  three  years.  The  most  recent  appraisals  for  fourteen  (44 
percent)  of  the  files  sampled  were  four  to  seven  years  old  and  the  most  recent  appraisal  for 
one  employee  was  dated  1989.  Seven  of  the  personnel  files  contained  no  appraisals. 

Without  documentation  of  their  job  performance,  employees  do  not  know  whether  they  are 
fulfilling  their  responsibilities  adequately.  Employees  who  are  probation  officers  do  not 
know  whether  they  are  monitoring  probationers  sufficiently.  Inevitably,  the  Department’s 
staff  has  less  direction  and  accountability  than  it  would  if  performance  appraisals  were  in 
place.  The  Handbook  for  Employees  of  The  City  and  County  of  San  Francisco  (August 
1998,  p.  14)  offers  the  following  description  of  the  City’s  evaluation  system  for  employees: 

The  purpose  of  the  performance  appraisal  system  is  to  ensure  that  employees 
understand  the  duties  and  responsibilities  for  which  they  are  being  held 
accountable,  evaluate  employees  on  their  performance,  identify  training  needs, 
improve  effectiveness,  provide  a basis  for  career  development  and  assure  quality 
service  to  the  public.  The  system  is  an  essential  tool  for  managerial  decision- 
making, [and]  assists  in  overall  communications  .... 


THE  DEPARTMENT  DOES  NOT  HAVE  A 
TRAINING  PROGRAM  TO  COMMUNICATE 
POLICIES  AND  PROCEDURES 

The  Department’s  training  officer  effectively  coordinates  training  required  by  the  State. 
Managers  also  conduct  training  from  time  to  time.  In  addition,  employees  participate  in  up 
to  three  days  of  offsite  training  of  their  own  choice,  typically  professional  workshops. 
However,  the  Department  does  not  have  a comprehensive  internal  training  program  to 
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ensure  uniform  understanding  of  new  or  changed  Department  needs  as  expressed  in  goals 
and  objectives,  policies  and  procedures.  Thus,  the  Department  foregoes  an  important 
means  of  ensuring  that  its  staff  is  performing  its  functions  in  a way  that  supports  the 
Department’s  goals  and  objectives. 

An  example  of  the  use  of  training  to  improve  the  way  the  staff  carries  out  a new 
management  initiative,  expressed  in  a policy  and  procedure,  is  the  Department’s 
implementation  of  its  new  case  banking  plan.  Management  knew  that  some  cases  were 
going  unsupervised  due  to  the  large  caseloads  handled  by  some  probation  officers  and 
issued  an  official  policy  setting  out  what  cases  can  be  placed  in  unsupervised  status 
(banked)  and  what  the  criteria  are  for  doing  so.  The  most  important  criterion  is  that  banked 
cases,  if  they  are  classified  for  risk,  must  be  rated  minimum  or  medium  risk.  However, 
management  also  recognized  that  staff  had  not  had  training  in  risk  assessment  for  up  to  15 
years  and  that  even  some  supervisors  were  either  untrained  in  risk  assessment  or  unaware 
of  the  risk  assessment  tools.  This  lack  of  training  existed  even  though  the  Department  has, 
for  at  least  17  years,  used  risk  assessment.  Management  therefore  conducted  training 
sessions  during  the  second  quarter  of  2000  to  ensure  that  the  staff  would  be  able  to  carry 
out  the  new  banking  procedure. 

If  the  Department  had  an  ongoing  system  to  train  its  staff  in  such  skills  as  risk  assessment 
and  others  that  are  required  to  achieve  the  Department’s  goals,  then  it  might  not  have  had 
to  conduct  intensive  training  to  implement  this  aspect  of  the  new  policy.  On  the  other  hand, 
the  risk  assessment  training  was  not  part  of  a systematic  approach  to  using  training  to 
reinforce  management  controls;  the  Department  has  no  established  program  to  ensure  that 
new  initiatives  in  policies  and  procedures  are  uniformly  understood  and  applied. 

The  Department  Complies  With  State- 

Mandated  Training  Requirements 

To  meet  the  State’s  requirements  for  training  probation  officers,  the  Department  has  a 
training  officer  who  coordinates  the  state-mandated  training  for  probation  officers  and  also 
serves  as  a unit  supervisor.  Because  they  are  peace  officers  under  state  law,  probation 
officers  are  subject  to  certain  training  requirements.  The  training  officer’s  duties  include 
keeping  records  of  probation  officers’  attendance  in  required  courses.  The  efforts  of  the 
training  officer  ensured  that  the  Department  passed  an  annual  state  review  of  mandated 
training  for  the  1998-99  period. 

The  Department’s  Internal  Training  Does  Not 

Adequately  Develop  or  Maintain  Employee 

Skill  Levels  to  Meet  Changing  Needs 

With  its  informal  approach,  the  Department  has  no  comprehensive  program  for  assessing 
or  meeting  the  ongoing  training  needs  of  its  employees  who  should  receive  updates  on 
changes  in  policies  and  procedures,  or  training  in  such  areas  as  risk  assessment  or  other 
job-related  activities.  Moreover,  no  training  system  ensures  that  all  the  Department’s 
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supervisors,  who  conduct  training,  uniformly  understand  new  policies  and  procedures. 
Instead,  unit  supervisors  train  their  staff  indepe  lently  and  according  to  their  own 
interpretations  of  policies  and  procedures.  The  t ming  officer  has  stated  that 
inconsistencies  in  policy  interpretations  become  Known  when  staff  members  complain  or 
when  errors  occur. 

As  part  of  the  Department’s  management  control  system,  training  should  ensure  that 
employees  are  focused  on  and  able  to  achieve  departmental  goals.  The  role  of  the  training 
officer  in  such  a system  should  go  beyond  that  of  coordinating  outside  training.  The 
training  officer  should  conduct  assessments  of  ongoing  training  needs  and  develop  the 
internal  programs  to  meet  those  needs. 


THE  DEPARTMENT’S  FORMS  DO  NOT 
ADEQUATELY  SUPPORT  THE  DEPARTMENT’S 
MANAGEMENT  CONTROL  SYSTEM 

The  Department’s  forms  do  not  serve  as  part  of  an  overall  management  control  system. 
Because  it  currently  faces  challenges,  the  Department  has  not  made  forms  control  a high 
priority  even  though  poorly  designed  forms  can  confuse  employees  and  encourage  the 
collection  of  incorrect  data.  The  Department  maintains  more  than  200  forms,  ranging  in 
importance  from  a facsimile  cover  sheet  to  the  form  on  which  probation  officers  calculate 
the  risk  that  a probationer  will  commit  a new  crime. 

Forms  supply  a means  for  managers  to  ensure  that  specific  information  appears  in  specific 
formats  and  documents  the  Department’s  daily  activities  or  goals  and  objectives.  When 
forms  are  not  well  designed  or  kept  current,  however,  they  can  lead  to  inappropriate  actions 
by  employees.  For  example,  the  Department’s  AP-44  narrative  form  shows  only  a date 
column  and  lined  paper  headed  “explanations.”  However,  the  Department  has  several 
pieces  of  standard  information  that  it  documents  on  this  case  narrative  form.  Among  them 
are  contacts  with  the  probationer,  address  changes,  probation  status,  and  employment.  The 
form  lacks  any  guidance,  such  as  check  boxes,  reminders,  or  even  references  to  relevant 
law  or  policies,  that  would  encourage  standardized  collection  of  the  data.  The  form  fails  to 
guide  probation  officers  in  their  daily  work  or  in  their  achieving  the  Department’s 
objectives. 

The  business  manager  stated  that  the  Department  has  no  system  for  reviewing  and  updating 
forms  regularly.  She  also  stated  that  the  Department  typically  updates  forms  in  response  to 
supervisors’  requests  or  in  reaction  to  complaints  from  third  parties,  such  as  judges.  A 
division  director  stated  that  division  directors  may  also  propose  updates  to  forms  based  on 
their  knowledge  of  changes  in  law  or  procedure.  The  Department’s  lack  of  a review  system 
for  forms  could  lead  employees  to  neglect  to  record  appropriate  information  to  support  the 
Department’s  day-to-day  actions.  Last  revised  in  September  1989,  the  Department’s  form 
for  monthly  court  activity,  AP-102,  is  an  example  of  a form  that  is  out  of  date.  Probation 
officers  record  on  the  form  the  reports  they  have  prepared  for  the  Court  in  a given  month. 
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In  addition,  the  officers  now  use  the  form  to  tally  reports  prepared  in  Spanish  even  though 
the  form  was  not  designed  to  have  such  a function.  Further,  the  form  still  contains  a 
column  for  activity  at  the  Municipal  Court,  which  no  longer  exists. 

The  informal  change  process  demonstrates  how,  without  management  control,  a form  can 
deviate  from  its  original  version.  The  noted  discrepancies  are  not  in  themselves  critical,  but 
there  is  no  assurance  that  some  staff  members  would  not  still  classify  reports  as  Municipal 
Court  or  that  all  staff  members  do  record  Spanish  language  reports  on  the  form.  In  a system 
in  which  there  are  no  systematic  controls  on  the  forms,  critical  discrepancies  could 
develop. 


RECOMMENDATIONS 

To  improve  its  oversight  of  the  Department,  the  Superior  Court  should  establish  a formal, 
ongoing  system  for  overseeing  the  Department  that  includes  regular  meetings  with 
agendas,  minutes,  and  action  steps  and  involvement  of  the  Department’s  management  team 
in  addition  to  the  chief  adult  probation  officer.  The  Court  should  work  with  the  Department 
to  prioritize  and  address  the  deficiencies  this  audit  report  identifies. 

The  City  should,  after  one  year,  assess  the  Department’s  progress  under  the  Court’s 
oversight  and  determine  whether  it  is  advisable  to  consider  placing  on  the  ballot  a charter 
amendment  that  would  transfer  from  the  Court  to  the  City  the  authority  to  appoint  the  chief 
adult  probation  officer. 

To  fulfill  more  effectively  its  mission  of  serving  and  protecting  the  citizens  of  San 
Francisco  through  the  investigation  and  supervision  of  adult  criminal  offenders,  the  Adult 
Probation  Department  should  take  the  following  actions: 

• Establish,  under  supervision  of  the  Court,  a management  improvement  plan  that 
includes  short-  and  long-term  objectives,  specific  action  steps,  and  regular  progress 
reports  to  the  Court.  The  Department  should  begin  implementing  the  plan  soon  enough 
that  budgetary  requirements  can  be  included  in  its  2001-02  budget  request. 

• Report  its  progress  pursuant  to  the  findings  in  this  audit  to  the  Board  of  Supervisors  in 
six  months  and  again  in  one  year. 

• Build  its  capacity  to  establish  management  controls  and  its  ability  to  implement  its 
goals  and  objectives  by  retaining  a consultant,  filling  its  Principal  Administrative 
Analyst  position,  or  by  other  means. 

• Acquire  training  for  the  senior  management  team  in  the  value  and  use  of  management 
controls  including  risk  assessment,  review  of  case  files  to  ensure  adequate  supervision 
by  probation  officers,  and  development  and  implementation  of  policies  and  procedures. 
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• Undertake  a comprehensive  revision  of  the  Department’s  policy  and  procedure  manual. 
The  Department  should  also  expand  the  manual  to  document  all  critical  departmental 
processes  and  standards,  including  those  for  updating  the  manual  regularly.  Further,  the 
Department  should  consider  placing  the  revised  manual  on-line  so  staff  can  access  the 
documents  easily  and  management  can  update  the  material  relatively  quickly. 

• Arrange  for  all  managers  and  supervisors  to  receive  intensive  training  from  the  City’s 
Human  Resources  Department  about  the  City’s  performance  appraisal  process.  The 
Department  should  implement  the  system  for  all  employees  as  soon  as  possible. 

• Establish  a formal  internal  training  program  to  include  planning  and  delivering  internal 
training  on  departmental  processes,  policies,  and  procedures.  This  will  be  particularly 
crucial  as  management  develops  and  implements  new  policies  and  procedures. 


We  conducted  this  audit  according  to  generally  accepted  government  auditing  standards. 
We  limited  our  review  to  those  areas  specified  in  the  audit  scope  section  of  this  report. 


Staff:  Karen  McVey,  Audit  Manager 

Millicent  Bogert 
Jodi  Darby 
John  Haskell 
Richard  Hendry 
Kai  Mander 
Leon  Valle 
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Appendix  A 

San  Francisco  Compared  to  Other  California  Counties 


The  table  and  charts  below  display  adult  probation  data  for  selected  California 
counties  from  calendar  years  1989  through  1998.  We  chose  the  counties  with 
populations  closest  to  that  of  San  Francisco;  five  counties  have  higher  populations, 
and  five  have  lower  populations.  We  also  included  the  next  two  highest  counties  in 
population  (San  Bernardino  and  Santa  Clara)  because  we  had  included  them  in  the  survey 
of  jurisdictions  we  used  for  benchmarking  the  performance  of  San  Francisco’s  Adult 
Probation  Department  (see  Appendix  B).  The  population  data  come  from 
capitolimpact.com,  a company  that  provides  governmental  and  political  data.  We  obtained 
probation  data  from  the  California  Attorney  General’s  Office. 

Exhibit  A-l  displays  the  number  of  adult  probation  cases  that  San  Francisco  and  other 
California  counties  reported  they  supervised  from  1989  through  1998. 


Exhibit  A-1  Total  Adult  Probation  Cases  (Sorted  by  Yearly  Average) 
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As  Exhibit  A-2  shows,  the  number  of  adult  probationers  in  San  Francisco  is  comparable  to 
that  of  other  California  counties  with  similar  populations.  For  the  10  calendar  years  1989 
through  1998,  San  Francisco’s  yearly  average  of  10,222  probationers  ranked  seventh 
among  the  1 3 counties  and  was  lower  than  the  average  for  all  the  other  counties  combined, 
which  was  10,981. 


Exhibit  A-2  Average  Number  of  Adult  Probationers 
San  Francisco  and  Other  California  Counties 
1989-1998 


Average  Number  of  Adult  Probationers 
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Exhibit  A-3  depicts  the  average  annual  change  in  the  number  of  probationers  over  the  10- 
year  period.  As  mentioned  in  Chapter  1 of  this  report,  San  Francisco  experienced  less 
fluctuation  in  the  size  of  its  adult  probation  population  than  most  other  counties.  Only  San 
Francisco,  Santa  Clara,  and  San  Joaquin  counties  averaged  less  than  6 percent  change,  on 
average,  each  year.  We  calculated  each  county’s  average  change  by  taking  the  change  in 
the  probationer  population  each  year  and  dividing  by  the  case  numbers  from  nine  pairs  of 
years  from  1989-90  to  1997-98. 


Exhibit  A-3  Average  Annual  Change  in  Probation  Cases 
San  Francisco  and  Other  California  Counties 
1989-1998 


Ftercent  Change  From  1989  to  1998 
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The  following  graph  charts  the  changes  in  the  numbers  of  probation  cases  between  the 
lowest  and  the  highest  case  counts  for  13  counties  over  a 10-year  period.  San  Francisco 
experienced  the  smallest  change  of  any  of  these  counties,  varying  from  a low  of  9,070  in 
1997  to  a high  of  1 1,528  in  1989 — a change  of  only  27  percent.  The  other  counties 
experienced  an  average  variance  of  97  percent.  As  mentioned  in  Chapter  1 of  this  report, 
compared  to  other  California  counties,  San  Francisco  has  a relatively  stable  annual  level  of 
adult  probation  cases. 


Exhibit  A-4  Percent  Change  in  Total  Probation  Cases 
Lowest  Year  to  Highest  Year 
San  Francisco  and  Other  California  Counties 
1989-1998 


Percent  Change  From  1989  to  1998 
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Appendix  B 

San  Francisco  Compared  to  Benchmarking  Counties 


This  appendix  describes  the  survey  we  conducted  of  other  probation  departments  and 
reports  the  specific  staffing,  caseload,  and  budget  data  on  which  we  based  some  of 
the  analyses  in  Chapter  1 of  this  report.  The  purpose  of  the  survey  was  to  obtain 
probation  information  from  other  jurisdictions  to  use  as  benchmarks  against  which  to 
compare  the  operations  of  San  Francisco’s  Adult  Probation  Department  (Department).  The 
written  survey  included  questions  about  staffing,  budget,  case  management,  risk 
assessment,  report  writing,  and  collections,  among  other  topics. 

We  sought  to  compare  information  from  the  Department  with  10  to  15  adult  probation 
departments  from  California  and  around  the  country.  We  searched  both  for  peer 
jurisdictions — departments  that  operate  under  similar  conditions  as  the  Department — and 
for  probation  departments  known  for  their  best  practices  in  managing  probation  cases. 

For  peer  counties,  we  chose  counties  with  populations  and/or  adult  probation  case  sizes 
that  are  similar  to  those  in  San  Francisco.  We  used  the  National  Association  of  Counties’ 
Web  site  (http://www.naco.org/counties)  to  find  all  U.S.  counties  with  1996  populations 
between  500,000  and  1,000,000  people.  We  obtained  probation  data  for  California  counties 
from  the  California  Attorney  General’s  Office. 

The  Department’s  chief  probation  officer  recommended  “best  practices”  counties  based  on 
his  knowledge  of  the  practices  employed  by  other  adult  probation  departments.  We 
included  a disproportionate  number  of  California  counties  because  they  must  abide  by  the 
same  laws  as  the  Department.  We  then  used  the  National  Association  of  Counties’  Web 
site  to  find  population  data  for  these  counties  with  “best  practices”  and  called  the  probation 
departments  to  learn  how  many  cases  they  supervise.  Case  sizes  were  not  verified. 

We  received  completed  surveys  from  11  of  the  15  departments  that  agreed  to  participate  in 
our  survey.  For  our  summary  of  budget  and  workload  information,  which  we  present  in 
Chapter  1 and  on  the  following  pages,  we  did  not  include  two  of  the  responding  counties 
(Fresno,  CA  or  Multnomah,  OR),  because  we  were  unable  either  to  conduct  follow-up  calls 
or  to  obtain  the  relevant  data. 
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Exhibit  B- 1 provides  information  regarding  staffing  and  workload  in  the  nine  counties  for 
which  we  wer-  able  to  obtain  reliable  information.  The  data  show  that  the  Department  does 
not  face  a greater  workload  than  adult  probation  agencies  in  these  counties.  The 
Department  was  in  the  middle  of  the  group  in  terms  of  all  three  ways  of  assessing 
workload:  cases  per  full-time  equivalent  position,  cases  per  probation  officer,  and  cases  per 
probation  officer  with  caseload.  As  mentioned  in  the  report,  the  Department  had  a higher 
percentage  of  its  full-time  equivalent  positions  occupied  by  probation  officers  compared  to 
percentages  for  adult  probation  functions  in  other  counties. 


Exhibit  B-1  Staffing  Information  for  San  Francisco  and  Benchmarking  Counties 
(Sorted  by  Cases  per  Probation  Officer  With  Caseload) 

County 

1998  General 
Population 

Total 

Cases 

Total 

Full-Time 

Equivalents 

Total 

Probation 

Officers 

Other 

Staff 

Probation 

Officers 

With 

Caseloads 

Probation  Cases  per  Cases 

Officers  as  Full-Time  per 

Percentage  Equivalent  Probation 
of  Staff  Officer 

Cases  per 
Probation 
Officer 
With 

Caseload 

San  Bernardino 

1,635,234 

13,005 

148 

96 

52 

35 

65% 

88 

135 

372 

Santa  Clara 

1,641,215 

25,314 

285 

149 

134 

90 

52% 

89 

170 

281 

Hamilton  (OH) 

847,403 

14,165 

235 

121 

114 

62 

51% 

60 

117 

228 

Alameda 

1 ,400,322 

13,643 

155 

103 

52 

61 

66% 

88 

132 

224 

Ventura 

731,967 

12,532 

165 

106 

59 

61 

64% 

76 

118 

205 

Marion  (IN) 

813,405 

9,602 

130 

108 

22 

52 

83% 

74 

89 

185 

San  Francisco 

745,774 

10,652 

127 

101 

26 

62 

80% 

84 

105 

172 

Hennepin  (MN) 

1,059,669 

19,544 

277 

190 

87 

130 

68% 

70 

103 

151 

San  Mateo 

700,765 

7,218 

120 

69 

51 

51 

58% 

60 

105 

142 

Sonoma 

433,304 

4,900 

95 

71 

24 

45 

75% 

52 

69 

109 

Average 

1,029,254 

13,325 

179 

113 

66 

65 

65% 

73 

115 

211 

Notes:  Average  does  not  include  San  Francisco.  All  data  are  for  adult  probation  functions  only. 
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Exhibit  B-2  shows  budget  information  from  the  counties  we  used  for  benchmarking.  Six  of 
the  nine  counties  we  obtained  data  from  had  higher  budgets  than  did  the  Department. 


Exhibit  B-2  Budget  Information  for  San  Francisco  and  Benchmarking  Counties 
(Sorted  by  Total  Budget) 

County 

Total  Budget 

Percent  of  Budget  From 
General  Fund 

Dollars  per  Adult 
Probation  Case 

Santa  Clara 

S 20,500,000 

75% 

S 810 

Hennepin  (MN) 

19,811,645 

81% 

1,014 

Hamilton  (OH) 

14,450,000 

85% 

1,020 

Alameda 

10,800,000 

69% 

792 

Ventura 

10,194,100 

43% 

813 

San  Mateo 

9,859,150 

52% 

1,366 

San  Francisco 

9,493.029 

81% 

891 

Sonoma 

91)00,000 

85% 

1,837 

San  Bernardino 

8,000,000 

96% 

615 

Marion  (IN) 

4,600,000 

65% 

479 

Average 

S 11,912,766 

72% 

S 972 

Note:  For  the  counties  other  than  San  Francisco,  we  obtained  the  budget  information  presented  through 
mailed  surveys  and  follow-up  calls  from  March  to  May  2000.  We  asked  for  current  budget  information,  but 
neither  the  budget  figures  nor  the  dates  to  which  they  applied  were  verified. 

Average  does  not  include  San  Francisco.  All  data  are  for  adult  probation  functions  only. 
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Exhibit  B-3  shows  that  the  dollar  amount  allocated  per  probation  case  in  the  Department  is 
in  the  middle  range  for  the  counties  we  surveyed,  with  five  counties  spending  less  per  case 
than  the  Department,  and  four  spending  more  per  case. 


Exhibit  B-3  Budget  Dollars  per  Case 
(Adult  Probation  Functions  Only) 
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Alfred  G.  Chiantelli 


Superior  Court  of  California 

County  of  San  Francisco 


September  27,  2000 


Mr.  Edward  Harrington 
Office  of  the  Controller, 

City  and  County  of  San  Francisco 
City  Hall,  Room  392 
#1  Dr.  Carlton  B.  Gooalett  Place 
San  Francisco,  CA  94102 


Dear  Mr.  Harrington: 

RE:  San  Francisco  Superior  Court  Response  to  the 

Performance  Audit  of  the  San  Francisco 
Probation  Department 

This  Court  acknowledges  that  there  have  been  problems  existing 
in  the  Probation  Department  of  San  Francisco  as  well  as  other  probation 
departments  in  other  counties  of  this  state.  Almost  all  of  the  probation 
departments  in  other  counties  have  reorganized  because  of  lack  of 
resources  and  heavy  workloads.  Many  claim  that  this  is  a result  of  local 
government  denying  the  departments  additional  probation  officers. 

Our  court's  informal  survey  of  other  counties  indicates  that 
other  counties,  unlike  San  Francisco,  have  thousands  of  unsupervised 
cases.  Many  of  them  have  banked  their  cases,  leaving  probationers 
basically  unsupervised . The  presiding  judges  of  those  counties  have 
indicated  that  if  more  probation  officers  were  available  their  probation 
departments  would  modify  supervision  procedures  and  eliminate  the  banking 
of  cases.  The  banking  program  in  San  Francisco  is  very  new;  it  was 

commenced  in  July  of  this  year.  However,  this  Court  recognizes  that  the 
problem  is  not  just  a fiscal  one  for  this  city  and  county  but  a 
supervision  problem  which  requires  this  court  to  reorganize  itself  and 
focus  the  current  chief's  valiant  efforts  to  address  problem  areas  that 
originated  over  previous  probation  administrations. 


CONTROLLER’S  AUDITS  DIVISION 


C-3 


Mr.  Edward  Harrington 
Office  of  the  Controller 
September  27,  2000 
Page  two 


We  are  not  alone  in  recognizing  the  need  for  improvements.  The 
Judicial  Council  of  California  has  recently  created  a Probation  Services 
Task  Force  to  assess  programs,  services,  organizational  structures,  and 
funding  related  to  probation  services  provided  by  counties  to  the  courts 
and  will  report  its  findings  and  recommendations  to  the  Judicial  Council. 
I,  as  the  first  elected  Presiding  Judge  of  the  Unified  Superior  Court,  and 
the  San  Francisco  Executive  Committee  of  Superior  Court  Judges  have  agreed 
that  we  will  establish  a formal  Judicial  Oversight  Committee  that  will 
ensure  that  probation  officers  are  providing  adequate  supervision.  This 
committee  will  conduct  regular  meetings  that  have  agendas,  minutes,  and 
action  steps.  This  Court  intends  to  invite,  when  appropriate,  members  of 
the  Controller's  Office  for  assistance  and  advice  regarding  supervision. 
In  the  meantime,  the  Chief  Probation  Officer  has  agreed  with  the  Court 
that  the  Department  will  dedicate  one  probation  officer  for  the  collection 
of  all  fines  and  penalties  of  all  the.  banked  probation  cases. 
Furthermore,  in  June  of  this  year,  the  department  has  hired  a Senior 
Collections  Officer  to  collect  all  fines  and  penalties. 

The  position  of  the  chief  probation  officer  is  one  currently 
appointed  by  the  judges  of  the  San  Francisco  Superior  Court  and  it  should 
remain  that  way  for  the  following  reasons : 

Fundamentally,  a probation  department  serves  the  court  by 
providing  information  to  the  court  regarding  sentencing  and  by  supervising 
people  placed  on  probation  by  the  court  according  to  the  terms  set  by  the 
court.  The  chief  probation  officer  does  not  set  broad  public  policies.  A 
judge  determines  whether  probation,  in  the  judge's  discretion,  will  be 
given,  what  the  terms  of  probation  should  be,  and  who  is  entitled  to  be  on 
probation.  Having  either  an  elected  chief  probation  officer  or  one 
appointed  by  the  Mayor  or  Board  of  Supervisors  would  create  a conflict 
that  is  unlikely  to  be  in  the  public's  interest.  The  honored  principal  of 
separation  of  powers  creates  a check  and  balance  between  the  Legislature 
(Board  of  Supervisors) , the  Executive  Branch  (Mayor,  District  Attorney, 
Sheriff),  and  the  Judicial  Branch;  this  stool  does  not  need  a fourth  leg. 
An  elected  chief  probation  officer  would  create  the  risk  of  being 
influenced  by  special  interest  groups  who  may  have  supported  that 
officer's  election.  The  chief  probation  officer  should  not  be  in  a 
position  of  trying  to  serve  two  masters;  that  would  be  untenable. 
Interjecting  the  Board  of  Supervisors  into  this,  through  selection  of  the 
chief  probation  officer,  is  misdirected  and,  potentially,  disruptive.  San 
Francisco  is  very  proud  in  maintaining  specialized  courts  (e.g.  Drug 
Court,  Domestic  Violence  Court)  where  teams  of  judges,  probation  officers, 
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district  attorneys,  and  defense  counsel  work  closely  together  to  supervise 
a defendant.  This  close  cooperation  required  for  such  programs  would  be 
hampered  if  a chief  probation  officer  appointed  by  the  Board  begins  to 
champion  a different  approach  to  supervision. 

The  argument  that  the  Board  of  Supervisors  should  control 
appointment  of  the  chief  probation  officer  because  the  Board  decides  the 
spending  level  of  the  Probation  Department  appears  to  be  unpersuasive . 
The  Board  sets  spending  levels  for  the  Sheriff,  District  Attorney,  Public 
Defender,  the  Grand  Jury,  and  other  departments  but  does  not  appoint  the 
department  head.  There  are  also  a large  number  of  community  organizations 
providing  contract  services  to  the  county,  spending  funds  appropriated  by 
the  Board  where  the  Board  does  not  appoint  the  head  of  such  agency. 
Judges  need  to  have  confidence  in  their  probation  department.  Having  a 
chief  probation  officer  that  is  accountable  to  anyone  other  than  the  court 
would  undermine  that  confidence. 

This  Court  looks  forward  to  the  challenges  of  the  oncoming  year 
in  attempting  to  reorganize  and  address  existing  problems  regarding 
organizational  structures  and  supervision  problems  in  the  probation 
department . 


Sincerely, 


Q-tU  s. 


ALFRED  G.  CHIANTELLI 
ading  Judge 


AGC/ah 


CONTROLLER’S  AUDITS  DIVISION 


C-5 


' 

■ 


' 


. 


* 


. 


RESPONSE  TO  THE  AUDIT 
ADULT  PROBATION  DEPARTMENT 


CONTROLLER’S  AUDITS  DIVISION 


D-l 


City  and  County  of  San  Francisco 


Adult  Probation  Department 
Hall  of  Justice 


ARMANDO  CERVANTES 

Chief  Adult  Probation  Officer 

September  26,  2000 


Edward  Harrington 
Controller 

City  & County  of  San  Francisco 
City  Hall,  Room  316 
#1  Dr.  Carlton  B.  Goodlett  Place 
San  Francisco,  CA  94102 

Re:  Response  to  Adult  Probation  Department  Audit 

Dear  Mr.  Harrington: 

On  behalf  of  the  San  Francisco  Adult  Probation  Department,  I respectfully  submit  to  your  office 
my  response  to  the  audit  report. 

I appreciate  and  value  many  of  the  issues  raised  in  this  report  and  the  recommendations  as  a 
guide  to  continue  with  the  changes  necessary  to  improve  the  operations  of  the  department. 

I would  like  to  acknowledge  your  evaluators  for  their  professionalism. 

Enclosed  is  my  audit  response  and  I hope  you  will  find  this  informative. 

Respectfully  submitted; 


Armando  Cervantes 
Chief  Adult  Probation  Officer 


AC:hbm 

auditltr 


(415)  553-1704 


880  Bryant  Street,  Room  200  San  Francisco,  CA 
94103-4673 


CONTROLLER’S  AUDITS  DIVISION 


D-3 


. 


City  and  County  of  San  Francisco 


Adult  Probation  Department 
Hall  of  Justice 


ARMANDO  CERVANTES 

Chief  Adult  Probation  Officer 


RESPONSE  to  the  ADULT  PROBATION  DEPARTMENT  Report 
As  Prepared  by  the  OFFICE  OF  THE  CONTROLLER, 

City  and  County  of  San  Francisco 

September  2000 


PREFACE 

The  report  regarding  the  Adult  Probation  Department  (APD)  as  prepared  by  the  Office  of  the 
Controller  is  important,  both  in  terms  of  the  issues  it  raises  and  in  those  it  does  not.  There  is 
much  to  consider  in  this  report,  and  much  that  is  of  value  to  the  APD.  There  are  also  several 
findings  and  conclusions  that  we  believe  might  benefit  from  more  complete  information. 

Toward  that  end,  the  APD  offers  this  response  document. 

It  should  be  noted  that  while  the  audit  team  worked  on  this  report  over  the  past  ten  months — a 
sizable  document  of  approximately  70  single-spaced  pages,  not  including  appendices— the  time 
available  to  the  APD  to  prepare  a response  has  been  short.  The  “exit  interview”  with  the 
auditors  occurred  on  August  24,  2000.  Since  that  time,  the  auditors  have  continued  to  meet 
with  APD  and  Court  representatives  to  discuss  the  report’s  findings  and  conclusions  through 
the  second  week  of  September  2000.  Revisions  made  to  the  original  draft  document  were 
received  by  the  APD  as  late  as  September  19,  2000. 

Responses  are  made  in  reference  to  specific  chapters  of  the  report,  as  outlined  in  the  Table  of 
Contents.  In  addition  to  providing  the  text  of  the  report  in  bold,  reference  is  made  to  the 
corresponding  page  number(s)  in  the  report  noting  where  each  quoted  section  is  located; 
however,  because  there  have  been  ongoing  discussions  with  the  audit  team  resulting  in 
revisions,  the  pagination  has  changed  slightly.  Therefore,  the  actual  pagination  may  be  slightly 
different  than  the  page  numbers  we  cite.  The  numbers  assigned  to  each  of  the  sections 
presented  in  bold  are  chronological  and  inserted  for  ease  of  reference  only.  J 

EXECUTIVE  SUMMARY 

CHAPTER  3:  DATA  COLLECTIONS  AND  REPORTS 

Report  Finding:  The  State-mandated  pre-sentence  reports  that  the  Department’s 
Investigations  Division  (division)  produces  to  guide  the  Court  in  its  sentencing  decisions 
are  complete,  and  the  division  generally  delivers  them  to  the  Court  in  a timely  manner... 

A survey  we  conducted  revealed  that  judges  are  satisfied  with  these  reports. 

Response:  Agree  with  finding. 
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Report  Finding:  The  number  of  continuances,  which  require  rescheduling  the  sentence 
dates  for  offenders,  is  rising...  We  based  our  conclusions  on  our  own  methodology 
because  the  division’s  statistics  for  total  reports,  late  reports  and  continuances  were 
unreliable.  Without  accurate  information  about  workload  and  performance,  the  division 
may  not  be  able  to  manage  its  resources  effectively  or  identify  areas  of  opportunity  or 
need. 

Response:  Refer  to  the  responses  provided  to  numbers  54,  55,  56,  57,  and  58. 

CHAPTER  4:  PLANNING  AND  REPORTING  PROCESSES 

Report  Finding:  The  Department  does  not  have  a coherent  planning  process  and  it  is 
not  using  management  reports  to  direct  its  progress...  Neither  the  task  force  nor  senior 
management  has  communicated  a vision  of  the  future  to  the  staff  or  defined  precisely 
how  the  Department  is  to  serve  and  protect  the  citizens  of  San  Francisco. 

Response:  Refer  to  the  responses  provided  to  numbers  59  and  63  regarding  the  planning 
processes  employed  by  the  Department;  to  numbers  36,  42,  55  and  63  regarding  management 
reports;  and  to  numbers  58  and  59  regarding  communication  of  the  Department’s  vision. 

Report  Finding:  Further,  Department  management  does  not  appear  to  place  much  value 
on  data  or  detailed  reports  in  managing  its  operations.  Senior  management  receives  few 
reports  on  department  activities,  and  the  chief  adult  probation  officer  receives  no  regular 
data  on  the  Department’s  primary  responsibility  which  is  supervising  probationers. 
Without  regular  reviews  of  performance  data,  the  Department  has  limited  ability  to  make 
timely,  well-informed  decisions  regarding  its  activities. 

Response:  Portions  of  this  claim  as  related  to  management’s  understanding  and  use  of  data 
and  reports  as  well  as  the  reports  management  receives  have  been  addressed  elsewhere  in  the 
report;  however,  the  claim  that  performance  reports  are  not  adequately  conducted  or  utilized  is 
valid.  The  reasons  for  this  are  not  presented  in  this  lengthy  report,  yet  they  bear  on  the  finding. 
High  middle  management  turnover,  often  due  to  retirements,  has  resulted  in  a large  number  of 
middle  managers  operating  under  provisional  appointments.  In  the  meantime,  the  county 
changed  the  performance  evaluation  form.  The  department  has  waited  for  permanent  position 
status  among  managers  before  investing  in  training  to  use  the  new  forms.  It  is  noted  that  7 of 
12  (58%)  middle  managers  are  provisional.  Requiring  provisional  managers  to  evaluate  staff 
without  permanent  managerial  status  and  without  adequate  training  in  the  procedure  does  not 
seem  advisable.  Among  the  5 middle  managers  who  do  have  permanent  status,  3 consistently 
conduct  performance  reports,  revealing  that  there  is  a need  for  follow-up  in  this  area.  All  senior 
management  staff  conduct  performance  reports. 


* Controller’s  Audits  Division  comments  on  the  Adult  Probation  Department’s 
response  begin  on  page  E-l. 
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Report  Finding:  The  Department  has  not  complied  with  the  Administrative  Code 
requirement  to  issue  an  annual  report  on  its  operations,  thus  losing  an  important 
opportunity  to  report  its  accomplishments  to  the  City,  the  Court,  the  public,  and  the 
Department’s  own  staff. 

Response:  This  finding  is  valid.  A report  is  to  be  prepared  annually  for  the  Board  of 
Supervisors  stating  the  condition  of  the  Department.  In  1998,  the  chief  was  still  very  new  to  the 
Department,  and  did  not  prepare  the  annual  report  covering  1997-98.  He  reviewed  three  prior 
annual  reports  and  found  that  the  only  thing  distinguishing  one  from  another  was  the  date  of  the 
reports.  Of  course,  a fourth  such  report  could  easily  have  been  submitted.  The  issue  as  to 
whether  or  not  reviews  such  as  these  are  useful  is  presumably  beyond  the  scope  of  this  study. 
Without  a usable  template  or  a depth  of  understanding  regarding  the  Department  during  the 
period  the  report  covered,  the  chief  chose  not  to  submit  a report  rather  than  submit  a useless 
report.  It  is  also  true  that  the  chief  has  not  submitted  an  annual  report  covering  fiscal  year 
1999-00  that  was  due  in  May.  A letter  from  the  City  regarding  the  need  for  this  report  was 
received  recently.  This  report  will  be  completed  shortly.  The  format  formerly  employed  will  be 
changed,  and  the  information  provided  will  not  be  “boiler  plate.” 

RESPONSES  MADE  TO  CLAIMS  MADE  IN  THE  NARRATIVE  PORTION  OF  THE  REPORT 
CHAPTER  1 : SUPERVISION  OF  PROBATIONERS 

1.  Pages  7 and  12:  “Probation  officers  had  not  attended  to  47%  of  the  38  open 
probation  cases  we  reviewed  that  the  Department  had  assessed  as  “maximum  risk”  in 
more  than  30  days.” 

According  to  the  report,  during  the  audit,  207  cases  were  reviewed;  yet,  apparently  only  38 
cases  were  reviewed  to  reach  the  above  conclusion.  A larger  sampling  may  provide  a more 
accurate  picture  as  an  n of  38  is  quite  small.  It  is  noted  that  probationers  serving  a jail 
sentence  or  those  in  residential  treatment  are  also  counted  among  open  cases,  but  they  are 
unavailable  to  report.  It  is  unknown  if  the  38  cases  reviewed  contained  such  cases. 
Furthermore,  the  average  caseload  size  for  maximum-risk  cases  is  196  cases  per  officer,  yet 
standards  regarding  contact  were  developed  for  caseloads  of  100  probationers  per  officer. 
According  to  the  survey  of  other  counties  conducted  by  the  audit  team,  the  average  caseload 
size  for  officers  supervising  maximum-risk  cases  is  94.5 — a caseload  size  in  which  meeting 
standards  of  contact  is  reasonable. 

2.  Page  7:  With  the  Department’s  staffing  and  workload  configuration  at  the  time  of 
the  audit,  seven  probation  caseloads,  containing  more  than  1,500  probationers,  were 
going  unsupervised.  However,  we  found  that  the  Department’s  overall  staffing  is 
comparable  to  that  of  similar  adult  probation  functions  in  other  jurisdictions. 
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At  the  time  of  the  audit,  the  seven  caseloads  noted  were  minimum-  or  medium-risk  caseloads 
that  have  since  been  banked  following  the  adoption  of  a banking  policy  by  the  Department  in 
July  2000.  In  adopting  such  a policy,  the  APD  aligned  itself  with  many  other  Probation 
Departments  in  California  and  nationwide  that,  faced  with  limited  resources,  have  chosen  to 
focus  services  on  probationers  who  pose  the  greatest  threat  (maximum-risk)  to  the  community. 
The  survey  of  other  counties  conducted  by  the  audit  team  revealed  that  all  counties  that 
responded  to  the  survey  practice  banking  to  some  degree,  and  many  to  a considerably  larger 
degree  than  that  proposed  in  San  Francisco,  as  outlined  below  in  Table  1. 


Table  1:  Banked  Cases  as  Compared  to 
All  Adult  Probation  Cases,  By  California  County 


County 

Total# 

Active 

Supervised 

Cases 

Total  # of 
Banked 
Cases 

Total  # of 
Cases 
(Supervised 
& Banked) 

% of  All 
Cases 
that  Are 
Banked 

# Adult  POs 
Employed  with 
Caseloads 

Alameda* 

8,253 

5,385 

13,643 

39% 

61 

San 

Bernardino* 

1,005 

12,000 

13,005 

92% 

35 

San  Mateo* 

3,326 

3,674 

7,000 

52% 

51 

Santa  Clara* 

16,618 

8,696 

25,314 

34% 

90 

Ventura* 

5,620 

6,912 

12,532 

55% 

61 

San 

Francisco** 

5,700 

4,700 

10,400 

45% 

62 

As  reported  by  the  Office  of  the  Controller  in  response  to  a survey  of  other  counties. 
The  banking  program  in  San  Francisco  is  very  new  (07/00).  Banking  figures  are  based 
on  estimates  provided  in  the  audit  report. 


The  survey  reveals  that  the  average  number  of  banked  cases  in  California  counties  that  use 
banking  is  5,307  cases  and  the  average  number  of  unbanked  cases  is  8,245  cases.  When  the 
percentage  of  cases  San  Francisco  proposes  to  bank  are  compared  to  the  percentage  banked 
in  California  counties  the  auditors  considered  similar  to  San  Francisco,  San  Francisco  falls  in 
the  middle  of  a range  that  stretches  from  34%  to  55%. 

Due  to  unique  factors  briefly  discussed  below,  San  Bernardino  may  be  considered  an  outlier. 
According  to  the  responses  to  question  15  on  the  survey  of  other  counties,  among  the  7 
California  counties  that  bank  cases,  no  ongoing  contact  is  made  in  Alameda,  Santa  Clara,  or 
Ventura  counties;  Santa  Clara  provides  contact  “as  needed;”  Fresno  requires  contact  every  30 
days;  and  San  Bernardino  banks  the  vast  majority  of  its  cases,  providing  over  12,000 
probationers,  many  who  represent  a “serious  threat  to  the  community,”  with  supervision  by  23 
probation  officers  (1  officer:565  cases,  minimum-  through  maximum-risk  probationers). 
According  to  the  San  Bernardino  Probation  Department,  officers  have  face-to-face  contact  in 
the  community  with  probationers  once  every  15  to  18  months.  According  to  that  Department, 
“this  is  an  inadequate  level  of  supervision  to  provide  for  public  safety.” 
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As  noted,  the  survey  reveals  that  the  average  number  of  banked  cases  in  counties  that  use 
banking  is  5,307  cases  and  the  average  number  of  unbanked  cases  is  8,245  cases,  figures  that 
translate  into  an  average  of  39%.  If  we  look  at  average  figures  for  the  California  sites  contained 
in  Table  1,  the  average  number  of  banked  cases  is  6,895,  the  average  number  of  active  case  is 
6,755,  and  the  average  total  number  of  cases  is  13,649.  Using  these  figures,  the  average 
percentage  of  banked  cases  in  California  counties  is  50.5%,  a figure  somewhat  higher  than  San 
Francisco  estimates  (45%)  it  will  eventually  bank  when  the  policy  is  fully  implemented. 

According  to  the  survey  of  other  counties,  the  average  caseload  size  among  officers 
supervising  maximum-risk  cases  is  94.5  cases.  The  range  is  large,  spanning  a low  of  50  cases 
per  officer  to  a high  of  213  per  officer.  San  Francisco,  at  an  average  of  196  maximum-risk 
cases  per  officer,  clearly  falls  in  the  high  end  of  this  range.  On  page  20  of  the  audit  report  it  is 
written  that  “prior  to  reorganization,  over  a third  of  the  Department’s  maximum-risk  caseloads 
contained  more  than  100  probation  cases,  with  7 of  these  caseloads  topping  200  cases  each.” 

It  bears  keeping  in  mind  that  several  maximum-risk  cases  are  supervised  by  specialized  units  in 
which  officers  would  optimally  serve  35-50  probationers,  yet  often  serve  considerably  more. 

The  survey  of  other  counties  revealed  that  the  average  caseload  size  among  counties  (question 
#7)  surveyed  is  168  cases  per  probation  officer,  with  the  highest  reported  average  at  208  cases 
per  officer  and  the  lowest  at  107.  The  number  of  APD  probation  officers  who  supervise 
caseloads  totals  62;  the  remaining  officers  work  in  investigations.  Prior  to  implementing 
banking,  the  average  caseload  per  probation  officer — not  factoring  in  caseload  restrictions  and 
generally  lower  average  numbers  of  cases  per  caseload  among  specialized  cases  that  skews 
the  average  number  of  general  supervision  caseloads  downward,  as  discussed  in  the  following 
paragraphs — was  168  cases  (10,400/62).  If  all  cases  were  indeed  “equal”  and  all  covered, 
each  officer  would  average  about  168  cases;  however,  in  reality,  caseloads  are  far  from  equal. 
The  recommended  caseload  size  in  the  Special  Division  typically  ranges  from  35  to  50  cases 
per  officer,  depending  upon  the  type  of  specialized  case.  If  one  deducts  the  number  of  officers 
in  the  Specialized  Division,  those  in  the  Investigation  Division,  and  Network  staff  (grant-funded), 
we  have  but  27  officers  to  supervise  about  7,159  cases,  resulting  in  an  average  caseload  of 
265  probationers  per  officer. 

Information  regarding  the  existence  and  staffing  of  specialized  units  in  the  other  counties 
surveyed  was  not  systematically  gathered.  Again,  this  is  unfortunate  because,  lacking  this  data 
results  in  the  comparison  of  apples  with  oranges.  Although  our  Department  has  neither  the 
time  nor  the  expertise  to  compile  this  data  for  all  the  counties  surveyed,  we  did  contact  a few 
other  counties  and  asked  them  to  describe  their  special  unit  assignments  (e.g.,  Contra  Costa, 
Sonoma,  and  San  Bernardino).  The  information  regarding  Santa  Clara  was  gleaned  from  that 
Department’s  written  response  to  question  number  7 of  the  survey  of  other  counties.  As  can  be 
seen  in  Table  2,  San  Francisco  fields  several  types  of  special  units  in  response  to  the  diverse 
needs  of  our  urban  community.  With  the  exceptions  of  DUI/DDP  and  Drug  Diversion  officers, 
average  caseloads  in  special  units  tend  to  be  well  below  those  found  among  general 
supervision  caseloads.  Of  course,  this  means  that  the  average  general  supervision  caseload 
size  must  be  considerably  larger  than  the  168  cases  the  report  cites  and,  indeed,  it  is.  We 
believe  this  is  a very  important  point  to  consider  when  comparing  jurisdictions.  Special  units 
are  tailored  to  the  specific  needs  of  a community,  providing  officers  with  specialized  skills, 
knowledge,  and  training — a priority  for  this  Department. 
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Table  2:  Specialized  Units  and  Assignments,  by  County 


County 

Domest 

ic 

Violenc 

e 

DUI  / 
DDP 

Drug 

Court 

Drug 

Abate 

-ment 

Dru 

g 

Dive 

r- 

sion 

Menta 

1 

Health 

Gan 

9 

Sex 

Offen 

d-ers 

Parole 

/ 

Proba 

-tion 

Com- 

munit 

y 

Projec 

t 

Contra 

Costa 

(09/00) 

5 POs 
capped 
at 

1:40 

2 POs, 
varies 

65 
case 
cap,  1 
PO 

Sonom 

a 

(09/00) 

9 POs, 
50 

cases 
per  PO 

1 PO 
per  40 
cases 

1 PO 
per 
55- 
65 
case 
s 

55-65 
case 
cap,  1 
PO 

San 

Ber- 

nardino 

(08/00) 

Santa 

Clara 

(11/99)* 

Average 
s 93 
cases 
per  PO 

DUI: 

1:94 

2 

66 

cases, 
1 PO 

Santa  Clara’s  Intensive  Supervision  Unit 
averages  50  cases  per  probation  officer. 

San 

Francis 

CO 

(07/00) 

1,308 
cases, 
14  POs; 
1:93 

1,07 

7 

case 

s, 

2 

POs; 

1:53 

3 

200 
cases, 
3 POs; 
1:66 

115 
cases, 
2 POs 
(grant) 

440 

case 

s, 

2 

POs; 

1:22 

0 

178 
cases, 
3 POs; 
1:59 

207 

case 

s, 

4 

POs; 

1:52 

90 

cases, 
1 PO; 
1:90 

64 

cases, 
1 PO; 
1:64 

141 
cases, 
2 POs; 
1:70 

*As  reported  in  relation  to  question  7 “notes,”  OC  survey  of  other  counties. 


When  analyzing  the  caseloads  among  special  units,  it  can  be  seen  that  they,  too,  are  relatively 
high  when  compared  to  some  of  the  other  counties.  Santa  Clara,  another  large,  urban 
Department,  has  special  unit  ratios  similar  to  those  in  San  Francisco.  Unlike  San  Francisco, 
however,  Santa  Clara  has  many  more  support  staff  than  does  San  Francisco;  52%  of  all  285 
Santa  Clara  staff  members  are  probation  officers  as  compared  to  80%  of  the  127  San 
Francisco  staff  members.  In  the  ratio  of  probation  officers  to  total  staff  members,  San 
Francisco  is  distinctly  higher  than  most  of  the  other  counties  it  is  compared  to  in  the  audit. 
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Finally,  the  audit  conclusion  that  staffing  in  San  Francisco  is  “comparable”  to  other  jurisdictions 
appears  to  hinge  on  the  selection  of  comparable  counties  to  include  when  making  such  a 
conclusion.  We  believe  that  if  we  are  to  be  compared  to  comparisons  with  other  counties  that 
the  comparison  be  based  on  similar  factors  and  that,  when  they  exist,  dissimilar  factors  should 
be  included  in  the  equation  (e.g.,  impact  of  special  units  on  caseload).  In  part,  the 
determination  regarding  the  appropriateness  of  APD  staffing  appeared  to  be  based  on  “peer 
county”  findings;  however,  the  only  variable  that  seems  to  have  been  taken  into  consideration  to 
determine  a “peer'’  is  population  size  (either  population  of  the  entire  community  or  of  the  entire 
probation  caseload).  That  choice  resulted  in  the  inclusion  of  some  “comparable”  counties  that 
bear  little  resemblance  to  San  Francisco,  a densely  populated  area  limited  in  size  by 
geographical  boundaries  but  very  much  an  urban  environment  with  an  international  reputation 
for  diversity  and  multiple  lifestyles.  Outside  of  California,  peer  counties  included  Hennepin 
County  in  Minnesota  (Minneapolis-St.Paul  area);  Marion,  Indiana;  and  Hamilton,  Ohio.  These 
communities  do  not  resemble  San  Francisco.  Within  California,  the  six  counties  cited  include 
San  Bernardino,  Santa  Clara,  Alameda,  Ventura,  San  Mateo,  and  Sonoma.  Again,  the  single 
factor— population  size — results  in  some  questionable  comparisons.  For  example,  San 
Bernardino  has  geographic  considerations  at  the  opposite  pole  of  those  affecting  San  Francisco 
and,  like  Sonoma,  is  a county  that  is  largely  rural  and,  therefore,  quite  different  from  the  urban 
environment  here. 

3.  Page  7:  In  its  efforts  to  manage  its  workload,  the  Department  relies  heavily  on 
manual  processes  for  tracking  its  probation  cases  and  does  not  fully  use  automated 
information  systems. 

This  statement  seems  to  infer  the  APD  has  chosen  not  to  use  automated  systems.  The 
Department  has  searched  for  automated  systems  and  continues  to  do  so.  Locating  funding  has 
been  and  continues  to  be  challenging,  particularly  for  an  integrated,  computerized,  fully 
automated  case  management  system  (CMS).  For  many  years,  the  APD  has  submitted  a three- 
year  plan  to  the  Electronic  Information  Steering  and  Process  Committee  (EISPC).  Two  APD 
Directors  sit  on  the  Department  of  Telecommunications  and  Information  Services  advisory 
committee  and  two  APD  staff  members  serve  on  the  steering  committee. 

Since  the  current  administration  was  installed  in  August  1997,  the  APD  has  made  significant 
improvements  in  its  information  systems  that  warrant  mentioning: 

• Installed  a centralized  telephone  system; 

• Acquired  personal  computers  for  all  probation  officers  that  allow  them  to  access  data 
department-wide; 

• Installed  a sophisticated  Kardex  system  that  both  stores  probationer  files  and  tracks  the 
location  of  files  at  any  given  time  (funded  by  the  Mayor’s  Criminal  Justice  Council); 

• Department-wide  email  is  being  developed  and  will  be  available  soon; 

• Internet  access  has  been  made  available. 

Eventually,  probationer  information  will  be  available  at  each  personal  computer.  Theoretically, 
this  is  available  now,  but  in  reality  it  is  limited  by  the  number  of  ports  that  are  physically 
available.  At  this  time,  all  supervisors  have  such  ports. 
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Finally,  any  largely  manual  system  that  handles  in  excess  of  10,000  cases  at  any  given  time  is 
unlikely  to  be  pristine;  nonetheless,  APD  staff  members  work  very  hard  to  report  reliable  data. 
Indeed,  any  system,  be  it  manual  or  automated,  that  tracks  complex  and  multiple  documents 
and  activities  contains  some  margin  of  error.  Based  on  information  verified  by  this  audit,  we 
appear  to  have  an  error  rate  of  about  2%.  While  no  errors  are  desirable,  this  is  a relatively  low 
margin  of  error,  particularly  given  the  manual  nature  of  much  of  it.  All  cases  are  entered  into 
the  Q-Pro  database  by  the  front  desk  staff,  after  which  cases  are  assigned  by  supervisors  to 
individual  probation  officers.  While  monthly  Q-Pro  print-outs  do  not  precisely  match  manual 
counts  as  reported  by  probation  officers,  we  believe  that  if  case  counts  were  examined  more 
closely,  they  would  be  found  among  caseloads  containing  200  to  300  probationers  or  more. 

The  errors  in  the  count  would  be  attributed  to  the  inherent  problems  of  trying  to  keep  track  of 
that  many  active  files 

4.  Page  9:  The  Department’s  July  2000  restructuring  reduced  the  number  of 
caseloads  to  63  and  limited  the  size  of  most  of  the  caseloads  to  100  or  fewer  probation 
cases. 

There  was  no  loss  of  staff  due  to  adoption  of  the  banking  policy;  hence,  the  basis  for  the  claim 
about  the  reduction  in  the  number  of  caseloads  is  confusing.  We  can  address  the  reasons  to 
restructure.  Reducing  caseloads  to  a cap  of  100  is  indeed  a goal — a goal  in  keeping  with  a 
recent  study  conducted  by  the  National  Association  of  Probation  Executives  published  in  2000 
entitled  “Transforming  Probation  through  Relationship.”  The  report  states,  “caseloads  that 
average  100  to  500  offenders  are  not  manageable.”  In  order  to  achieve  a balanced  approach 
to  supervising  high-risk  offenders,  policy  was  adopted  to  restructure  the  supervision  of  high-risk 
offenders,  capping  the  caseload  at  a maximum  of  100  cases.  The  objective  is  to  provide  more 
productive  and  focused  probation  officers  in  the  community  capable  of  supervising  high-risk 
probationers — offenders  who  present  the  greatest  risk  to  public  safety. 

5.  Page  9:  To  compare  the  Department’s  workload  and  operations  to  the  adult 
probation  functions  in  other  jurisdictions,  we  conducted  a survey  of  counties  within 
California  and  in  other  states  and  also  reviewed  10  years’  data  on  adult  probation  cases 
in  the  City  and  12  other  California  counties. 

The  survey  of  other  counties  was  completed.  When  survey  findings  were  requested,  partial 
findings  were  made  available  to  the  APD.  Since  the  full  findings  neither  appear  in  an  appendix 
nor  were  presented  to  the  APD,  some  claims  are  made  based  on  survey  findings  that  cannot  be 
referenced.  As  for  the  ten-year  review  of  APD  data,  the  report  rarely  presents  longitudinal  data 
spanning  the  past  ten  years.  Most  data  cited  does  not  go  back  beyond  1995-96. 

6.  Page  9:  The  Department  cannot  provide  the  exact  number  of  probationers  it 
supervises,  and  its  reporting  process  is  flawed.  These  weaknesses  call  into  question  its 
ability  to  track,  oversee,  and  hold  probationers  accountable  for  fulfilling  the  conditions 
of  probation. 
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In  reaching  the  above  conclusion,  the  Office  of  the  Controller  (OC)  reviewed  207  case  files  and 
found  that  among  76  probationers  convicted  of  sex,  drug,  and  arson  offenses,  only  33  (43%) 
had  registered  with  the  Police  Department.  However,  upon  APD  review  of  the  207  cases 
provided  to  the  auditors  using  the  San  Francisco  Police  Department’s  automated  criminal 
history  record,  we  found  that  47  of  the  65  (72.3%)  probationers  convicted  of  drug  offenses  had 
registered  as  had  all  4 sex  offenders  and  the  sole  arson  offender  included  in  the  sample  group. 
We  believe  that  of  the  103  cases  reviewed  that  required  registration,  85  had  registered, 
resulting  in  a registration  rate  of  82.5%  rather  than  the  43%  reported.  A registration  rate  of 
82.5%  is  admittedly  lower  than  it  ought  to  be,  but  it  is  considerably  less  severe  than  reported. 

Furthermore,  drug  diversion  cases  were  included  in  the  cases  reviewed,  yet  there  is  no 
distinction  offered  in  the  report  concerning  the  types  of  drug-related  probation  cases  reviewed. 
Since  narcotics  charges  in  drug  diversion  cases  do  not  require  probationers  to  register  under 
section  1000  of  the  Penal  Code,  and  since  all  cases  cited  for  lack  of  registration  appear  to  be 
drug-related  cases,  this  also  could  affect  the  percentage  of  cases  cited  for  non-registration. 

7.  Page  10:  Using  the  same  baseline  figures  each  month  perpetuates  errors  over 
time. 

In  manual  systems,  when  errors  do  occur,  they  can  be  more  difficult  to  locate  and  identify  as 
data  cannot  be  reviewed  systematically  without  reviewing  individual  files;  however,  frequent  or 
monthly  hand  counts  of  all  files  without  reliance  upon  any  baseline  figures  would  require  staff 
well  in  excess  of  those  currently  available.  Furthermore,  with  full  implementation  of  the  banking 
system,  the  error  rate  in  case  counts  is  expected  to  diminish  as  individual  caseloads  of  several 
hundred  cases  per  officer  will  no  longer  exist. 

8.  Page  10:  Despite  discrepancies  identified  as  the  result  of  a limited  count  in  1997, 
the  Department  has  no  policy  or  practice  of  regular  recounts.  The  Department  does  not 
consider  it  a priority  to  gather  and  report  accurate  caseload  data. 

Discrepancies  in  caseload  count  do  not  reflect  discrepancies  in  case  assignments  or  workload. 
New  cases  are  assigned  based  on  their  risk  classification  and  the  number  of  available  officers 
to  receive  cases.  Officers  are  not  assigned  cases  when  on  vacation  or  leaves.  Not  all  cases 
are  closed  in  a timely  manner  and  these  cases  are  carried  on  the  statistics  as  active  cases, 
which  may  increase  an  officer’s  caseload  count,  until  the  cases  are  closed.  Officers  with  very 
high  caseloads  sometimes  close  out  cases  in  bulk  and  not  monthly.  The  number  of 
probationers  returned  to  court  and  the  Court’s  sentence  are  other  factors  that  impact  on 
caseload  count. 

9.  Page  1 1 : The  Department  was  unable  to  provide  us  with  five  open  case  files  we 
requested. 
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The  APD  provided  the  evaluators  with  hundreds  of  files  during  the  lengthy  audit,  and 
cooperated  with  the  auditors  in  every  way  requested  and  at  all  levels.  All  pertinent  information 
was  given  to  the  auditors  so  they  would  have  what  was  needed  to  conduct  this  study.  If 
auditors  were  unable  to  locate  a particular  file,  it  is  unknown  to  the  Department  when  this 
occurred,  whether  one  auditor  may  have  had  files  being  requested  by  another  auditor  (since 
multiple  auditors  worked  on  discrete  portions  of  the  audit  simultaneously),  or  whether  more  than 
one  attempt  to  locate  a file  was  made.  During  the  time  the  study  was  underway,  the  Kardex 
system  was  installed  and  is  now  fully  operational.  Under  this  automated  system,  each  file  is 
assigned  a code  that  can  be  scanned  thereby  making  it  possible  to  know  the  location  of  every 
file  at  any  given  time. 

1 0.  Page  1 1 : The  new  file  system,  however,  will  not  be  capable  of  providing  the 
Department  with  data  about  caseload  size  or  probationer  compliance  with  conditions  of 
probation. 

The  Kardex  system  was  never  intended  to  provide  data  regarding  caseload  size  or  the 
conditions  of  probation.  Financed  by  the  Mayor’s  Criminal  Justice  Council,  the  Kardex  is  a file 
system,  not  a CMS.  The  Kardex  does  not  eliminate  the  long-term  need  for  a CMS,  but  it  has 
effectively  addressed  the  long-standing  problem  of  file  management,  as  addressed  in  #9  above. 

1 1 . Page  1 1 : The  division  director  downplayed  the  importance  of  reconciling  the 
conflicting  totals,  stating  that  a difference  of  a few  hundred  cases  is  unimportant 
because  probation  officers  know  the  cases  for  which  they  are  responsible. 

The  Division  Director  is  confident  that  systems  are  in  place  to  track  the  caseload.  Although 
conflicting  totals  appear  from  time  to  time,  the  rate  of  the  discrepancies  has  been  statistically 
insignificant. 

12.  Page  13:  Management’s  apparent  lack  of  enforcement  of  the  Department’s 
contact  requirements  for  maximum-risk  probationers  means  that  potentially  dangerous 
criminals  are  remaining  unsupervised  for  extended  periods. 

The  average  caseload  size  for  maximum-risk  cases  is  196  cases  per  officer,  yet  standards 
regarding  contact  were  developed  for  caseloads  of  1 00  probationers  per  officer.  According  to 
the  survey  of  other  counties  conducted  by  the  audit  team,  the  average  caseload  size  for  officers 
supervising  maximum-risk  cases  is  94.5 — a caseload  size  in  which  meeting  standards  of 
contact  is  reasonable.  Following  restructuring  full  implementation  of  the  banking  policy,  a 
manageable  caseload  size  as  applied  to  high-risk  probationers  will  be  in  place.  According  to 
research  cited  above,  a “manageable”  caseload  for  maximum-risk  offenders  does  not  exceed 
100  cases  at  most. 

13.  Page  13:  The  Department’s  failure  to  ensure  that  sex,  drug,  or  arson  offenders 
register  creates  a risk  to  the  community  and  denies  accurate  information  to  criminal 
justice  agencies. 
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Upon  review  of  this  claim,  we  found  that  it  was  not  supported  by  the  actual  data.  Refer  to  the 
response  to  #6  above. 

14.  Page  16:  In  the  employee  survey  we  conducted,  34  of  85  respondents  cited 
workload  as  the  issue  the  Department  most  needs  to  address.  However,  despite 
management’s  belief  that  the  Department  does  not  have  enough  employees  to  handle 
the  workload,  we  found  that  the  Department’s  overall  staffing  is  comparable  to  that  of 
similar  adult  probation  functions  in  other  jurisdictions. 

The  audit  finding  also  ignores  the  stated  belief  by  management  that  there  are  insufficient 
employees  to  handle  the  workload,  and  the  corroborating  evidence  gathered  from  staff  to  the 
same  effect.  Employees  were  surveyed  as  part  of  the  audit,  and  50.5%  of  employees 
responding  ranked  caseload  as  the  first  or  second  priority  among  issues  the  department  most 
needs  to  address.  When  asked  to  respond  to  the  question,  “what  one  thing  could  be  done  to 
improve  services  to  APD  clients,”  29  of  the  70  respondents  (40%)  who  responded  suggested 
that  the  Department  reduce  the  workload.  Survey  results  echo  what  management  and 
supervision  staff  reported  to  auditors.  Furthermore,  the  audit  neglects  to  raise  the  fact  that, 
according  to  its  survey  of  other  counties,  San  Francisco  appears  to  be  the  last  of  those 
surveyed  to  adopt  a banking  policy.  In  regard  to  the  conclusion  that  the  Department’s  overall 
staffing  is  comparable  to  other  jurisdictions,  refer  to  #2  above. 

15.  Page  16:  As  of  May  2000,  the  Department  was  staffed  to  its  budgeted  level,  which 
is  the  highest  it  has  been  since  fiscal  year  1993-94.  Nonetheless,  in  June  2000,  more 
than  1,500  probationers  in  seven  caseloads  had  no  probation  officers  assigned  to  them 
and,  therefore,  were  receiving  no  supervision.  The  Department  did  not  reassign  these 
probationers  to  other  probation  officers  because  it  felt  that  current  caseload  sizes  were 
already  too  large. 

The  average  caseload  size  in  general  supervision  was  very  high  in  May  2000;  at  that  time,  it 
averaged  268  cases  per  officer. 

16.  Page  16:  Although  the  chief  and  his  senior  managers  acknowledge  that  workload 
is  an  issue  and  have  even  identified  potential  solutions,  they  have  been  slow  to  act  on 
them.  For  example,  the  Department  had  been  discussing  an  approach  to  managing  its 
workload  that  would  place  low-risk  probationers  who  require  a lower  level  of  supervision 
in  large  banked  caseloads  and  leave  probation  officers  with  more  time  for  high-risk 
cases,  a practice  which  many  probation  agencies  follow.  In  July  2000,  only  after  two 
years  of  discussion  and  a perceived  staffing  crisis  did  senior  management  develop  a 
policy  for  dealing  with  low-risk  probationers. 

The  report  notes  that:  “The  Department  undertook  a reorganization  in  July  2000  which  may 
lighten  employees’  workload;  however,  the  new  structure  leaves  a large  number  of  probationers 
without  any  supervision.”  This  is  a situation  in  which  there  are  no  easy  answers  and  the 
decision  to  bank  cases  was  not  made  lightly.  Banking  was  adopted  as  a last  resort  in  an  effort 
to  bring  caseloads  down  to  manageable  levels.  This  was  done  after  the  fiscal  year  00-01 
budget  was  determined  and  it  became  clear  that  the  Department’s  budget  request  to  fill 
approved  positions  could  not  be  accommodated  this  year  if  the  greater  goal  of  a balanced 
budget  was  to  be  achieved,  as  it  was.  Regardless,  APD  intends  to  systematically  review  those 
“banked”  cases. 
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17.  Page  17:  The  number  of  probation  cases  the  Department  supervises  had  not 
changed  significantly  over  the  last  10  years,  according  to  the  data  the  Department 
reported  to  the  California  Department  of  Justice  (Justice  Department).  The  Department’s 
budget  has  seen  a net  increase  of  73%~or  an  average  of  7%  per  year — over  that  period. 
The  Department’s  number  of  budgeted  positions  has  been  somewhat  more  variable. 
However,  since  the  fiscal  year  1994-95,  staff  levels  have  steadily  increased. 


Table  3:  New  Hires  in  the  Adult  Probation  Department,  1990-91  to  2000-01 


Year 

# POs 
Hired 

Probation  Officers  Hired  and  Assigned  to... 

Units 

DV 

Networ 

k 

ISU 

Drug 

Invest. 

Supervis 

n 

90-91 

2 

2 

91-92 

1 

1 

92-93 

1 

1 

93-94 

1 

1 

94-95 

2 

1 

1 

95-96 

1 

1 

96-97 

4 

1 

1 

2 

97-98 

5 

3 

1 

1 

98-99 

26 

11 

10 

2 

1 

1 

2 

99-00 

0 

00-01* 

2 

2 

Totals 

46 

19 

13 

2 

5 

4 

2 

1 

Partial  period,  7/1/00  through  9/5/00. 


Budgeted  Positions:  The  statement  of  steadily  increasing  staff  levels  since  fiscal  year  1994-95 
is  somewhat  confusing.  According  to  Department  records,  staff  levels  were  largely  stagnant 
between  1990-91  and  1996-97.  Of  the  46  probation  officers  hired  in  the  ten-year  period 
spanning  1990-91  to  2000-01,  37  (80%)  were  hired  to  replace  officers  who  retired  or  left  the 
Department  for  positions  elsewhere.  As  can  be  seen,  the  fiscal  year  1998-99  was  a significant 
year  for  hiring  staff  to  backfill  the  positions  of  those  who  had  left  or  retired  from  the  Department 
and  to  staff  the  Domestic  Violence  Unit.  The  largest  staff  increase  in  the  Specialized  Division 
occurred  in  1998-99  when  the  APD  was  able  to  secure  6 new  probation  officers  and  a unit 
supervisor  dedicated  to  the  Domestic  Violence  Program.  The  increase  was  partly  in  response 
to  augmented  budgets  in  the  San  Francisco  Police  Department  DV  unit  from  6 inspectors  to  20 
in  1997  and  in  the  District  Attorney’s  DV  unit  from  4 to  12  (9  attorneys  and  2 investigators).  The 
staff  increase  that  year  also  reflected  what  is  considered  as  an  acceptable  caseload  average  for 
officers  providing  services  to  batterers  as  well  as  to  the  victims  (i.e.,  caseloads  of  50  cases  per 
officer). 
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In  the  fiscal  years  1999-00  and  thus  far  in  2000-01 , there  have  been  few  staffing  changes.  In 
1998,  an  officer  was  added  to  the  Drug  Court  program  as  secured  through  a state  grant  in 
which  the  San  Francisco  Court  was  the  lead  agency.  The  grant  has  since  expired;  the  officer 
remains  in  the  assignment.  In  April  2000,  the  Hispanic  Gang  Caseload  in  the  Intensive 
Services  Unit  was  divided  and  a second  officer  was  assigned  to  the  program.  This  change  was 
in  response  to  community  concerns  associated  with  gang  violence.  The  selected  Spanish- 
speaking officer  was  transferred  from  the  Investigation  Division  where  the  vacancy  remains. 

The  APD  in  essence  reallocated  resources  in  this  instance  to  address  community  concerns  and 
officer  safety  issues  without  an  additional  allotment  from  the  city  budget.  In  July  2000,  an 
officer  was  transferred  to  a Mental  Health  caseload  in  the  Intensive  Services  Unit  in  response  to 
a federal  grant.  The  Sheriff’s  Department  is  the  lead  agency.  A vacancy  remains  unfilled  in  the 
General  Supervision  Division.  With  the  exception  of  the  Domestic  Violence  Program,  all  other 
probation  officers  hired  between  1994-95  and  the  present  reflect  hires  to  replace  officers  who 
retired  or  left  the  Department. 


Table  4:  Adult  Probation  Department  Total  Annual  Budgets  and 
General  Fund  Portion  of  the  Annual  Budgets,  Fiscal  Years  1990-91  through  2000-01 


Fiscal  Year 

Total  Annual 
Budget 
($) 

Increase/Dec  reas 
e from  the  Prior 
Year 
(%) 

General  Fund 
Portion  of  the 
Annual  Budget 
($) 

Increase/Decreas 
e from  the  Prior 
Year 
(%) 

1990-91 

5,489,842 

- 

5,489,842 

- 

1991-92 

6,006,576 

9 

6,006,576 

9 

1992-93 

6,534,712 

9 

6,534,712 

9 

1993-94 

7,203,373 

10 

7,203,373 

10 

1994-95 

6,786,491 

(6) 

6,786,491 

(6) 

1995-96 

7,276,501 

7 

7,276,501 

7 

1996-97 

8,974,167 

23 

7,105,551 

(3) 

1997-98 

9,272,829 

3 

7,379,958 

4 

1998-99 

8,965,754 

(3) 

7,221,244 

(3) 

1999-00 

9,493,029 

6 

7,677,735 

6 

2000-01 

9,818,212 

3 

8,238,536 

7 

Department’s  Budget:  The  statement  that  the  Department’s  budget  has  seen  a net  increase  of 
73%--or  an  average  of  7%  per  year — over  that  period  [the  last  ten  years],  is  true  of  the  general 
fund  portion  of  the  annual  budget.  Perhaps  more  informative  is  a review  of  the  general  fund 
portion  of  annual  budgets  over  the  past  five  years,  fiscal  years  1996-97  through  2000-01 . In 
this  five-year  period,  it  is  easily  seen  that  budget  increases  of  9-10%  annually  typical  of  the 
early  years  of  the  decade  were  not  continued  in  the  second  half  of  the  decade.  In  two  of  the 
five  years,  the  general  fund  portion  of  the  annual  budgets  decreased  by  3%  when  compared  to 
the  prior  year  (1996-97  and  1998-99),  and  when  increases  occurred  in  the  remaining  three 
fiscal  years,  they  were  relatively  modest  at  4%,  6%,  and  7%  (1997-98,  1999-00,  and  2000-01, 
respectively).  The  general  fund  portion  of  the  APD  budget  was  $7,105,551  in  1996-97  and  is 
$8,238,536  in  2000-01,  representing  an  increase  of  $1,132,985  or  15.95%  over  a five-year 
span — a percentage  that  represents  an  average  increase  of  3.19%  annually. 
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Not  mentioned  in  the  audit  report  is  the  fact  that  the  total  annual  APD  budgets  have  increased 
somewhat  more  dramatically  beginning  in  1996-97  due  to  augmentation  of  the  general  fund 
portion  of  the  Department’s  budget  with  significant  grant  funds.  Between  1990-91  and  1995-96, 
the  total  annual  budget  relied  entirely  on  general  fund  monies.  Although  the  general  fund 
portion  of  the  1996-97  budget  fell  3%  that  fiscal  year,  the  overall  Department  budget  increased 
23%  that  same  year  because  of  grant  funding.  Throughout  the  remainder  of  the  decade,  grant 
funds  have  continued  to  augment  the  Department’s  total  annual  budgets.  In  2000-01 , funding 
sources  other  than  the  general  fund  account  for  16.1%  of  the  total  annual  budget  of 
$9,818,212. 

The  increase  of  50%  in  general  fund  monies  allotted  to  the  Adult  Probation  Department  in  the 
ten-year  period,  1990-91  through  2000-01,  is  similar  to  increases  awarded  the  offices  of  the 
District  Attorney  and  Public  Defender,  but  well  below  the  increases  experienced  by  the  Sheriffs 
Department  and  Juvenile  Probation  during  the  same  period. 

18.  Page  17:  In  having  a comparatively  predictable  number  of  probationers  and  a 
rising  staff  level,  San  Francisco  is  in  an  advantageous  position  to  budget  resources, 
plan  programs,  and  structure  itself  to  carry  out  its  mission  efficiently.  However,  when  31 
of  39  of  the  probation  officers  with  caseloads  responding  to  the  survey  of  Department 
employees  say  they  spend  a lot  of  time  reacting  to  crises,  their  response  indicates  that 
management  has  not  provided  an  effective  structure  for  employees  to  address  a 
relatively  constant  workload. 

Addressing  problems  and  crises  that  arise  is  inherent  in  probation  work.  Unlike  the  audit 
conclusion,  we  believe  that  management  has  responded  innovatively  to  caseload  needs, 
promoting  specialized  caseloads  managed  by  highly  trained  officers  capable  of  addressing 
especially  difficult  situations  an  responding  to  community  concerns.  Furthermore, 
management’s  pursuit  and  fostering  of  grant  opportunities  (representing  over  10%  of  the  total 
annual  budget  in  FY  99-00)  to  provide  grant-funded  coverage  at  no  or  low  cost  to  the  city 
provides  services  that  would  not  otherwise  be  available. 

19.  Page  19:  Exhibit  9 shows  how  the  Department  can  have  more  probation  officers 
but  fewer  total  staff  than  the  other  counties  do.  San  Francisco  has  fewer  support  and 
administrative  staff  as  a proportion  of  its  total  staff  than  all  but  one  other  county  we 
surveyed. 

In  the  ratio  of  probation  officers  to  total  staff  members,  San  Francisco  is  distinctly  higher  than 
most  of  the  other  counties  it  is  compared  to  in  the  audit. 

This  is  a situation  largely  beyond  the  control  of  management.  It  is  a factor,  however,  that 
distinguishes  this  Department  from  most  others  and  which,  in  the  short  run,  limits  the  staffing 
options  available  to  the  APD.  This  is  an  important  issue  affecting  many  aspects  unique  to  the 
San  Francisco  APD.  The  proposed  use  of  support  staff  commonly  used  elsewhere  (e.g., 
Probation  Aides)  would  likely  result  in  meet  and  confer  issues  with  union  representatives 
regarding  the  utilization  of  paraprofessionals.  Furthermore,  when  union  reservations  such  as 
these  are  combined  with  a largely  manual  recordkeeping  system,  the  demands  on  San 
Francisco  probation  officers  can  be  seen  to  be  both  significantly  different  from  other  jurisdictions 
and  more  challenging.  It  is  little  wonder,  then,  that  the  report  found  that  “administrative  tasks 
consume  a large  portion  of  the  workday  for  many  probation  officers  with  workloads”  and  that 
“officers  cannot  supervise  cases  effectively  when  unnecessary  paperwork  consumes  their  time.” 
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We  note  that  the  restrictions  on  the  use  of  support  staff  in  San  Francisco  render  comparison  of 
San  Francisco  probation  officers  with  those  in  other  “comparable”  counties  less  persuasive. 

20.  Page  20:  The  chief  and  his  senior  managers  developed  the  reorganization  plan  in 
June  2000  in  response  to  what  they  deemed  a crisis  precipitated  by  the  City  turning 
down  their  request  for  additional  probation  officers. 

First,  as  noted  elsewhere  in  the  body  of  the  audit  report,  the  reorganization  plan  had  been 
under  development  for  some  time;  it  was  not  dashed  together  in  June  2000.  Second,  the  City’s 
choice  not  to  fund  approved  positions  was  and  is  its  prerogative.  As  such,  Departments 
respond  accordingly.  In  this  case,  plan  B,  restructuring  and  adopting  a banking  policy  to 
prioritize  and  address  the  issue  at  hand  was  implemented.  As  discussed  elsewhere  in  the 
report  and  as  the  survey  of  other  counties  revealed,  banking  is  the  rule  rather  than  the 
exception  in  most  counties.  Third,  the  request  was  not  for  additional  probation  officers  but  for 
officers  whose  positions  had  already  been  approved,  an  important  distinction. 

21.  Page  20:  Initially,  the  Department  intends  to  include  in  the  banked  caseload  only 
those  cases  it  assesses  as  medium-  or  minimum-risk.  However,  it  has  planned  for  the 
possibility  of  having  to  assign  some  maximum-risk  probationers  to  the  banked  caseload. 

Banking  is  a low-risk  monitoring  system  that  will  not  include  those  who  are  assessed  as 
maximum-risk  probationers  in  the  banked  caseload.  The  policy  focuses  only  on  low-  and 
medium-risk  assessed  offenders  for  inclusion  in  this  system.  The  policy  contains  a provision 
requiring  the  automatic  review  and  reassessment  of  high-risk  cases  after  six  months.  If,  after 
six  months,  probationers  have  complied  with  court  orders,  been  involved  in  no  further  violations 
of  the  law,  have  met  financial  responsibilities  (i.e.,  paid  fines  and  fees),  and  are  regularly 
attending  or  have  completed  prescribed  treatment  programs,  the  reassessment  may  result  in 
the  assignment  of  a lower  risk  level. 

22.  Page  20:  The  Department’s  lack  of  oversight  of  probationers  in  the  banked 
caseload  means  that  these  offenders  will  be  able  to  complete  their  sentences  without 
complying  with  the  court-ordered  conditions  of  their  probation,  including  payment  of 
fines,  fees,  and  restitution,  registration  as  a sex,  drug,  or  arson  offender,  and 
participation  in  treatment  programs. 

Cases  that  involve  sex  and  arson  offenders,  and  those  cases  prescribed  by  the  law  involving 
convicted  drug  dealers  will  not  be  placed  on  the  low-risk  monitoring  system.  It  may  be  that  the 
audit  interpreted  “drug  offenders”  too  broadly.  Many  offenders  convicted  of  using  drugs  are  not 
required  by  law  to  register.  There  is  a legal  distinction  between  drug  users  and  those  who  are 
convicted  of  possession  in  large  amounts  or  drug  traffickers/sellers  who  are  indeed  required  to 
register.  The  majority  of  drug  offenders  convicted  of  using  drugs  are  diverted  through  the  Drug 
Court.  The  report  does  not  appear  to  recognize  these  distinctions. 

23.  Page  21:  The  Department  did  not  update  any  policies  or  establish  any  procedures 
to  ensure  that  probationers  in  the  supervised  caseloads  receive  proper,  much  less 
improved,  oversight  from  probation  officers.  As  previous  and  subsequent  sections  of 
this  report  illustrate,  the  lack  of  functioning  management  systems  and  clear,  up-to-date, 
enforced  policies  and  procedures  play  a significant  role. 
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T;-  are  is  policy  and  procedure  concerning  banking  and  the  supervision  of  caseloads.  Regarding 
the  broader,  claim  of  the  lack  of  management  systems,  including  up-to-date  policies  and 
procedures,  the  report  gives  little  recognition  to  the  fact  that,  prior  to  the  current  administration, 
most  policies  and  procedures  had  not  been  updated  for  10  years  or  more.  Given  this  fact,  the 
relevance  of  extant  policies  and  procedures  of  record  in  1997  was  poor;  they  did  not  reflect 
current  working  conditions.  At  this  time,  we  estimate  that  35  to  40%  of  APD  policies  and 
procedures  are  current.  Updating  policies  is  time-consuming  work,  yet  we  are  carefully  and 
methodically  addressing  the  task  by  prioritizing  the  review  process  and  downloading  all  current 
policies  and  procedures  onto  employee  computers  as  they  become  available. 

Although  seldom  mentioned  in  this  report,  the  Task  Force  is  instrumental  in  the  ongoinc  c ew 
and  development  or  revision  of  policies.  Subcommittee  members  review  each  policy  ana 
remove  or  rewrite  those  that  are  out  of  date,  note  the  next  (future)  date  of  review,  and  w ice  new 
policies  and  procedures  determined  to  be  administratively  necessary.  All  first  line  managers 
and  directors  give  input  regarding  newly  drafted  and  revised  measures,  after  which  the  chief 
reviews  them.  Upon  approval  by  the  chief,  certain  revised  or  newly  proposed  policies  must  be 
submitted  to  the  City  Attorney  for  legal  review  prior  to  adoption  and  implementation. 

Realistically,  updating  the  policy  and  procedure  manual  is  a process  that,  with  continued  diligent 
attention,  we  estimate  will  be  completed  by  the  end  of  fiscal  year  2001 . The  priority  assigned 
this  task  is  reflected  in  the  fact  that  the  Task  Force  and  its  subcommittees  meet  regularly,  in 
most  cases  every  two  weeks 

Furthermore,  a specialized  subcommittee  of  the  Task  Force,  the  Supervision  Policy  and 
Procedure  Committee,  is  currently  reviewing  all  supervision-related  policies  and  procedures, 
using  a similar  process,  and  it  is  estimated  that  this  subcommittee  will  complete  its  work  by  the 
end  of  fiscal  year  2001 . 

In  a related  task,  the  Supervision  Standards  Committee,  yet  another  Task  Force  subcommittee, 
is  working  on  a related  task:  developing  a written  supervision  guide  for  caseload  managers. 

The  ommittee  is  (a)  submitting  training  recommendations  to  the  chief  (this  has  been  done);  (b) 
cos  g out  and  prioritizing  equipment  needs  (this  process  is  currently  underway);  and  (c) 
identifying  supervision  contact  standards.  Again,  the  projected  completion  date  for  this  process 
is  by  the  end  of  fiscal  year  2001 . 

24.  Page  21 : San  Bernardino  County  maintains  most  of  its  12,000  probation  cases  in 
one  caseload,  which  a team  of  probation  officers  supervise  by  selecting  cases  at  random 
to  check  for  compliance  with  probation  conditions. 

We  contacted  the  San  Bernardino  County  chief  probation  officer  and  the  presiding  judge  and 
received  in  return  a letter  from  the  judge  and  information  from  the  chief.  This  model  is 
suggested  as  appropriate  for  San  Francisco,  we  recommend  taking  a much  closer  look  at  what 
actually  occurs  in  San  Bernardino.  As  noted  in  #2  above,  San  Bernardino  banks  the  vast 
majority  of  its  cases,  providing  over  12,000  probationers,  many  who  represent  a “serious  threat 
to  the  community,”  with  supervision  by  23  probation  officers  (1  officer:565  cases,  minimum- 
through  maximum-risk  probationers).  According  to  the  San  Bernardino  Probation  Department, 
officers  have  face-to-face  contact  in  the  community  with  probationers  once  every  15  to  18 
months.  According  to  that  Department,  “this  is  an  inadequate  level  of  supervision  to  provide  for 
public  safety.” 
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25.  Page  21:  The  Department’s  policy  for  banking  lower-risk  offenders  has  no 
provision  for  transferring  a probationer  back  to  a regular  supervision  caseload  or  for 
returning  probationers  to  court  for  failure  to  comply  with  court-ordered  conditions  of 
probation. 

The  banking  system  does  not  allow  for  a serious  violation  to  go  unnoticed.  The  APD  has  put  in 
place  a Motion  to  Review  (MTR)  Unit  that  handles  defendants  who  reoffend  and  whose  cases 
are  in  the  banked  caseloads.  The  unit  is  comprised  of  a supervisor  and  four  probation  officers 
When  new  offenses  occur  and  the  District  Attorney  files  a motion  to  revoke,  the  unit  prepares 
the  necessary  court  report  and  reassesses  the  case  (risk  score)  according  to  departmental 
guidelines.  Those  cases  that  are  reassessed  as  maximum-risk  are  sent  to  a maximum-risk 
case  officer  for  supervision.  A daily  duty  officer  is  assigned  to  provide  daily  coverage  to  the 
banked  caseload.  In  the  first  six  months  of  this  year,  938  cases  were  returned  to  the  Court 
based  upon  a Motion  to  Revoke. 

Policies  and  procedures  are  currently  being  developed  and  will  be  implemented  shortly 
regarding  the  supervision  of  banked  cases.  The  Department  plans  to  reassign  one  full-time 
probation  officer  (currently  assigned  to  cover  maximum-risk  cases)  who  will  be  responsible  for 
conducting  random  checks  of  banked  cases.  These  checks  will  include  warrant  checks,  review 
of  rap  sheets,  monitoring  payments  of  fees  and  fines,  and  monitoring  enrollment  and 
attendance  in  treatment  programs.  Banked  probationers  found  to  be  in  non-compliance  will  be 
returned  to  the  Court. 

26.  Pages  21-22:  According  to  the  Los  Angeles  County  Probation  Department,  it  has 
been  able  to  manage  a doubling  of  its  adult  probation  cases  over  the  last  15  years  while 
maintaining  1978  staff  levels... 

It  should  be  noted  that  Los  Angeles  banks  24,000  cases.  In  addition,  the  following  factors 
applicable  to  Los  Angeles  do  not  apply  to  San  Francisco  at  this  time:  they  have  an  automated 
CMS;  their  use  of  temporary  employees  with  lower  classifications  than  probation  officers  is  not 
currently  an  option  here  due  to  the  union  position  on  this  issue;  Los  Angeles  uses  a kiosk 
system  to  supervise  low-risk  probationers.  Although  not  mentioned  in  the  report,  this  is  a 
practice  San  Francisco  has  investigated  at  some  length  and  is  interested  in  pursuing  further. 
The  cost  is  approximately  $75,000  per  kiosk. 

27.  Page  22:  San  Bernardino  County  Probation  reports  that  it  responded  to 
increasing  average  caseload  sizes  by  reorganizing  itself  into  field  units  and  an  office 
unit... 

San  Bernardino  reported  to  us  in  some  detail  that  it  has  23  officers  who  provide  field 
supervision  to  nearly  13,000  cases  of  all  risk  levels,  resulting  in  a ratio  in  excess  of  1:550.  “This 
ratio,  with  a field  contact  every  15  to  18  months,  is  an  inadequate  level  of  supervision.”  All 
adults  on  formal  probation  in  San  Bernardino  County  keep  in  contact  with  the  department 
otherwise  through  a mail  reporting  system.  The  23  officers  mentioned  above  have  field 
supervision  for  these  cases. 

28.  Page  22:  Sonoma  County  uses  probation  assistants  at  a ratio  of  one  assistant  to 
every  ten  probation  officers  to  help  with  case  administration. 
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As  noted  several  times  elsewhere,  the  union  position  on  this  issue  opposes  the  use  of 
paraprofessionals  in  this  manner. 

29.  Page  22:  The  Los  Angeles  County  Probation  Department  supplements  its  staff 
with  reserve  deputy  probation  officers  and  1400  volunteers  who  provide  a variety  of 
services  to  probationers. 

The  distinction  between  probation  departments  that  serve  both  juvenile  and  adult 
probationers — unlike  San  Francisco — is  not  made  and,  in  this  instance,  makes  a difference  as 
these  are  practices  adopted  by  the  Juvenile  Division  of  the  Los  Angeles  County  Probation 
Department  rather  than  the  Adult  Division. 

30.  Page  22:  The  Seattle  Municipal  Court  Probation  Services’  Volunteer  Program  has 
also  used  volunteer  staff  extensively  to  support  its  POs  in  working  with  drunk  driving 
and  DV  offenders.  The  program  uses  senior  citizens,  student  interns,  and  professional 
people  to  help  monitor  selected  probation  cases. 

It  is  noted  that,  to  be  effective,  volunteer  programs  require  a significant  commitment  on  the  part 
of  staff  and  Department  resources.  While  volunteers  indeed  can  be  very  effective,  factors  that 
must  be  considered  when  using  volunteers  include  the  following:  the  need  to  conduct 
background  checks  on  each  potential  volunteer  prior  to  service,  ongoing  coordination  of 
volunteers  and  volunteer  activities,  training  of  volunteers,  ongoing  oversight  of  volunteers,  and 
changes  in  Department  policies  and  procedures  regarding  the  appropriate  use  of  volunteers. 
There  is  an  inherent  cost  to  operating  a volunteer  program  that  includes  monitoring, 
coordinating,  training,  background  checks  and  recruitment  maintenance  associated  with 
volunteer  programs. 

31.  Page  22:  San  Francisco  would  benefit  from  looking  to  these  and  other 
jurisdictions  for  new  ideas  on  ways  to  augment  its  staff  and  enhance  the  productivity  of 
its  probation  officers. 

San  Francisco  has  looked  at  other  jurisdictions.  We  are  very  much  aware  of  the  way  probation 
assistants  are  used  elsewhere  to  support  the  work  of  the  Department.  We  have  looked  into 
adopting  a kiosk  system  for  low-risk  offenders,  and  plan  to  pursue  this  option  further.  We  have 
also  investigated  a mail  reporting  system  for  banked  cases. 

32.  Page  23:  Another  example  of  the  Department’s  underutilization  of  information 
systems  exists  in  the  probation  component  of  the  City’s  Court  Management  System 
(CMS),  which  the  Department  uses  to  research  cases  and  enter  certain  data...  The  aging 
system  is  now  perceived  by  many  as  failing  and  unreliable.  An  information  systems 
contractor  for  the  CMS  says  both  the  court  clerks  and  the  Department’s  front  desk  staff 
can  make  errors  in  data  entry  that  may  not  be  corrected.  As  discussed  in  this  chapter, 
the  Department  has  relied  on  flawed  systems  to  track  its  number  of  probation  cases. 
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The  CMS  was  developed  in  1974  as  a booking  and  court  calendaring  system.  It  uses  first 
generation  programming  language  (fourth  generation  is  currently  used).  As  the  years  passed, 
several  modules  were  developed  to  meet  the  specific  needs  of  the  various  user  departments 
(Sheriff,  District  Attorney,  Public  Defender,  Adult  Probation).  It  is  an  integrated  database — one 
department  can  enter  information  and  all  departments  can  share  that  information.  Data  can  be 
entered  once.  This  is  unique  to  San  Francisco. 

With  ISD,  the  Department  had  developed  a sub-system  of  CMS  called  QPRO  (Query 
Probation)  in  1978.  QPRO  was  completely  rewritten  in  1989.  The  sub-system  allowed  the 
Department  to  enter  the  name  and  phone  number  of  both  the  investigating  officer  and  the 
supervising  officer.  A decision  was  made  by  the  previous  chief  to  start  using  this  system.  Wth 
the  information  in  the  database,  other  agencies  could  call  up  the  screen  and  access  the 
information,  thus  reducing  the  workload  at  the  front  desk.  In  addition  to  entering  the  officer’s 
name  and  number,  there  are  eight  lines  of  free  text  for  the  front  desk  to  keep  track  of 
information.  However,  sorting  and  counting  would  be  rudimentary,  at  best,  with  QPRO. 

This  is  not  a CMS.  At  most,  further  programming  could  produce  a very  simple  CMS. 
Furthermore,  programming  projects  for  CMS  are  handled  by  the  CMS  Policy  Committee  which 
is  comprised  of  all  the  criminal  justice  agencies.  Each  department  designates  a representative 
to  sit  on  the  Committee.  Projects  must  be  approved  by  the  Committee. 

Funding  has  always  been  a problem.  Each  department  allocates  money  each  year  to  run  CMS, 
based  on  a formula  developed  in  the  1970s.  Money  to  support  enhancements  was  routinely  cut 
during  the  budget  process,  including  funds  for  case  management  systems  as  well  as  other 
projects. 

33.  Page  23:  Fortunately,  the  Dept  of  Telecommunications  and  Information  Services 
(DTIS)  has  been  working  on  behalf  of  the  City’s  criminal  justice  departments  to  select, 
purchase,  and  install  a replacement  to  the  aging  CMS  database  at  no  cost  to  the 
Department.  In  addition  to  the  same  type  of  criminal  justice  data  now  in  the  CMS,  the 
new  system — named  the  Justice  Tracking  and  Information  System  (JUSTIS) — will  include 
case  management  components  for  many  of  the  City’s  criminal  justice  departments, 
including  the  APD.  According  to  the  DTIS  manager  on  the  project,  DTIS  will  supply 
funding  and  technical  support  to  install  the  system. 

The  JUSTIS  project  was  conceived  in  1997  by  the  former  chief,  the  former  head  of  the  ISD 
(now  DTIS),  and  the  former  head  of  EISPC  (now  COIT).  There  was  an  agreement  to  replace 
the  CMS.  ISD  was  able  to  secure  funding  in  the  amount  of  $1 ,000,000  to  begin  a needs  study. 
DTIS  was  asked  to  be  the  system  integrator.  The  JUSTIS  Committee  has  had  a committee  of 
departmental  representatives  who  have  been  working  very  closely  for  the  past  several  years  to 
define  needs  and  guide  Tech  Prose,  a DTIS  subcontractor,  to  develop  an  RFP. 

The  integration  concept  turned  into  a case  management  system  for  the  agencies.  The  RFP 
took  18  months  to  develop.  The  responses  have  just  recently  been  received  and  the 
department  is  in  the  process  of  reviewing  them. 
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On  an  independent  note,  the  Department  has  looked  for  a case  management  system  for  a 
number  of  years.  When  it  came  to  discussions  about  implementation,  funding  was  consistently 
a thorny  issue.  General  fund  money  has  always  been  scarce.  We  have  looked  at  kiosk 
systems,  as  well  as  the  newer  technology. 

The  RFP  process  is  scheduled  to  proceed  as  follows.  After  a department  selects  a particular 
system,  that  choice  will  go  before  the  entire  committee.  Depending  upon  funding  and  the 
committee  process,  it  may  or  may  not  be  selected.  We  are  interested  in  the  latest  technology. 
We  have  seen  several  applications  under  development  using  palm  pilots  and  laptops.  Again, 
this  is  dependent  upon  funding.  Funding  is  coming  from  the  Mayor’s  Office  through  the  Mayor’s 
Criminal  Justice  Council,  and  not  from  DTIS. 

CHAPTER  2:  COLLECTIONS 

34.  Page  30:  To  his  credit,  the  chief  adult  probation  officer  (chief)  has  identified 
collection  of  probationer  fines  and  fees  as  an  issue  the  Department  needs  to  address. 

He  believes  the  Department  could  be  collecting  more  and  has  stated  that  he  wants  to 
improve  the  system  of  collection.  However,  the  Department’s  collection  processes  and 
procedures  have  seen  little  change  in  support  of  this  goal. 

Until  fiscal  year  1999-00,  collections  staffing  had  remained  unchanged;  however,  in  that  year,  a 
Senior  Collections  Agent  position  was  added — a position  that  was  increased  to  a full-time  post 
in  the  fiscal  year  2000-01  budget.  The  position  was  filled  recently  and  is  expected  to  result  in 
increased  collections  of  fines  and  fees.  The  Department  has  written  policies  and  procedures 
regarding  collections. 

In  addition  to  increased  collections  staffing,  the  Department  contends  that  the  collection  of  fines 
and  fees  has  indeed  increased  over  the  past  three  years,  as  can  be  readily  seen  in  the 
following  table.  When  the  current  chief  assumed  office,  he  forbade  waivers  for  probationers 
unless  inability  to  pay  was  firmly  established.  A readily  apparent  trend  of  rising  collections, 
starting  in  fiscal  year  1996-97  and  rising  substantially  each  year,  is  a matter  of  record.  Between 
fiscal  years  1993-94  and  1999-00,  general  fund  revenues  collected  have  increased  by 
$213,522,  an  increase  of  45.3%.  Collections  in  1999-00  ($684,504)  under  the  current 
administration  were  more  than  double  than  the  total  amount  collected  four  years  earlier  in  1995- 
96  ($330,505)  under  the  former  administration. 


Table  6:  General  Fund  Revenues  Collected 
by  the  Adult  Probation  Department,  1993-94  through  1999-00 


Fiscal  Year 

General  Fund  Revenue: 
APD  Collections  of 
Fees  and  Fines 

Increase  or  Decrease  from 
Previous  Year’s  Collections 

1993-94 

$470,982 

- 

1994-95 

$464,010 

($6,972) 

1995-96 

$330,505 

($133,505) 

1996-97 

$371,892 

$41,387 

1997-98 

$431,734 

$59,842 

1998-99 

$604,129 

$172,395 

1999-00 

$684,504 

$80,375 
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35.  Page  30:  The  Department  has  not  taken  steps  to  analyze  systematically  the 
collection  problem  or  its  magnitude...  Senior  managers  receive  only  one  piece  of 
collection  information:  the  Department’s  total  monthly  revenues.  They  do  not.receive — 
and,  according  to  the  Department’s  head  cashier,  have  not  asked  for— information 
essential  to  evaluating  the  Department’s  overall  collection  performance  and  to 
identifying  areas  in  need  of  attention.  The  information  the  Department  needs  to  analyze 
its  collections  is  available. 

The  Department  receives  monthly  reports  that  are  broken  out  into  collections  per  officer  as  well 
as  per  unit.  Reports  are  distributed  to  officers  and  supervisors  that  show  which  accounts  have 
bad  addresses  (undeliverable),  and  which  clients  have  cases  terminating  in  from  30  to  90  days 
with  monies  still  owing. 

36.  Page  30:  Data  for  approximately  2,000  cases  ordered  to  pay  fines,  fees,  or 
restitution  are  missing  from  the  accounting  system. 

Lacking  knowledge  of  how  the  figure  of  “2,000  cases”  was  derived,  the  Department  questions  if 
the  auditors  took  the  number  of  probationers  and  assumed  that  all  involved  fines  or  fees  as  a 
condition  of  probation.  This  is  not  the  case.  There  may  be  municipal  court  cases  included  in 
this  figure  that  do  not  have  fines  or  fees  assessed.  There  may  also  be  diversion  cases  included 
in  the  figure  that  do  not  have  fines  or  fees  assessed. 

37.  Page  30:  In  addition,  we  found  that  between  June  and  December  1999,  the 
Department  had  no  current  addresses  for  an  average  of  46%  of  probationers  with 
financial  obligations  and  could  not  send  them  bills,  thus  lowering  the  likelihood  these 
probationers  would  pay. 

The  APD  agrees  that  the  collection  of  fines,  fees,  and  restitution  are  important  activities.  In 
general  terms,  probationers  tend  to  be  a highly  mobile  population,  changing  jobs  and  addresses 
at  a rate  higher  than  the  norm,  and  earning  incomes  lower  than  the  norm.  A significant  number 
of  probationers  are  homeless,  transients,  and/or  mentally  ill — a population  with  very  few 
resources  and  who  rarely  have  reliable  permanent  addresses,  making  it  especially  difficult  to 
locate  and  bill  them.  These  are  not  excuses  for  collection  problems,  but  they  are  factors  that 
influence  collections.  An  outcome  of  this  audit  is  the  provision  for  a full-time  Senior  Collections 
Agent  in  this  year’s  budget,  a position  filled  recently.  We  anticipate  an  increase  in  collections 
this  year. 

38.  Pages  30-31 : Our  review  of  207  random  probation  cases  revealed  that... the 
Department’s  accounting  system,  which  is  supposed  to  record  all  cases  with  financial 
obligations,  contains  records  for  only  72%  of  the  open  probation  cases  under  the 
Department’s  supervision,  a discrepancy  of  20.  Further  research  confirmed  a significant 
discrepancy.  We  tested  the  accounting  system  for  20  probation  cases  that  should  have 
been  recorded  and  found  that  3,  or  15%,  were  missing.  The  cashier’s  office  corroborates 
this  finding,  asserting  that  sometimes  a probationer  will  come  to  the  window  to  pay  and 
the  cashier’s  office  will  have  no  record  of  the  case. 
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The  sampling  is  too  small  to  draw  any  meaningful  conclusions.  Furthermore,  probationers  do 
occasionally  come  to  the  window  following  sentencing  to  pay,  and  find  that  they  do  not  yet  have 
an  account  set  up.  This  can  be  the  result  of  a court  slip  that  has  not  yet  been  sent  to  the 
Department  by  the  Superior  Court  clerk’s  office.  A court  slip  is  the  catalyst  that  generates  the 
set-up  of  a new  account  in  the  cashier’s  office.  It  is  the  Department’s  source  of  information  as 
to  the  disposition  of  the  case  and,  without  the  court  slip,  we  cannot  set  up  an  account  in  our 
accounting  system  to  impose  and  bill  the  necessary  fees,  fines,  and  restitution.  Finally,  open 
cases  are  not  necessarily  active  cases— meaning  that  until  a case  is  closed  and  the  officer 
submits  a change  of  status  form  to  the  cashier’s  office,  it  remains  open. 

39.  Page  31:  Though  unlikely,  the  possibility  also  exists  that  probation  officers  could 
inappropriately  accept  payment  directly  from  these  probationers. 

Policy  and  procedures  dictate  that  probation  officers  are  never  to  accept  payment  from 
probationers  directly.  They  are  to  refer  or  walk  probationers  to  the  cashier’s  office  to  make 
payments.  Under  no  circumstances  are  officers  to  accept  money  from  probationers.  The  ten- 
month  audit  revealed  no  such  occurrences. 

40.  Page  31 : These  gaps  in  information  result  from  flaws  in  the  Department’s 
process  for  transferring  case  data  to  the  cashier’s  office,  which  has  no  way  to  ensure 
that  it  receives  information  on  every  case  that  it  should.  Furthermore,  keeping  the 
cashier’s  office  informed  appears  to  not  be  a priority  for  the  Department. 

Keeping  the  cashier’s  office  informed  is  a priority.  There  is  a formal  process— an  accounts 
payable  status  form — which  is  to  be  submitted  by  the  probation  officer  to  the  cashier’s  office 
indicating  any  changes  in  status,  that  is,  address  change,  bench  warrant  status,  closed  case. 

41.  Page  31 : The  Department  does  not  track  or  report  any  collection  data  according 
to  divisions,  units,  or  probation  officers. 

The  Department  does  track  collections  on  a monthly  basis  according  to  probation  officer, 
division,  and  unit. 

42.  Page  32:  The  Department  has  neither  published  a policy  or  statement  regarding 
the  effort  to  improve  collections  nor  undertaken  action  to  assist  probation  officers  in 
enhancing  probationer  compliance  with  financial  obligations. 

Probation  cases  often  remain  active  for  three  to  five  years.  The  current  administration  forbade 
the  practice  previously  employed  of  allowing  waivers  of  fees  without  first  establishing  ability  to 
pay. 

The  Department  has  hired  a full-time  Senior  Collections  Agent.  She  is  currently  being  trained, 
and  we  are  in  the  process  of  developing  policies  and  procedures.  The  draft  of  the  policies  and 
procedures  have  been  shared  with  the  supervisory  staff  and  will  be  finalized  and  distributed 
shortly. 
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The  APD  is  assessing  the  feasibility  of  a proposal  that  would  have  investigations  probation 
officers,  assisted  by  the  Senior  Collections  Agent,  establish  ability  to  pay  during  the 
investigation  process. 

43.  Page  32:  Probationers  who  do  not  pay  and  are  not  sanctioned  for  failing  to  pay 
will  learn  that  the  Department  will  not  hold  them  to  the  terms  of  probation,  and  these 
probationers  may  share  this  information  with  others  in  the  system. 

State  law  says  that  probationers  cannot  be  punitively  sanctioned  for  failure  to  pay.  Inability  to 
pay  has  to  be  established.  When  a matter  concerning  payment  is  returned  to  Court,  the  Court 
holds  a full  hearing  regarding  the  defendant’s  ability  to  pay. 

44.  Page  34:  Even  probationers  who  have  the  means  to  pay  their  financial 
obligations  are  not  doing  so. 

This  statement  appears  to  be  based  on  2 cases  among  the  207  reviewed,  a number  that 
translates  into  less  than  1%  of  all  cases  reviewed. 

45.  Page  34:  In  contrast,  9 of  11  probation  departments  we  surveyed  regularly  return 
cases  to  Court  to  extend  or  revoke  probation  for  failure  to  pay  fines,  fees,  or  restitution. 

In  San  Francisco,  there  are  no  sanctions  imposed  for  failure  to  pay;  however,  there  is  an 
alternative  available  that  allows  probationers  an  alternative  method  of  meeting  their  obligations. 
Probationers’  obligations  regarding  fees  or  fines  can  be  converted  from  monetary  obligations  to 
obligations  met  by  working  in  the  Sheriffs  Work  Alternative  Program  (SWAP). 

46.  Page  34:  Nor  does  the  Department  contract  with  a collections  agency  or  take  any 
other  formal  action  (such  as  using  credit  reports,  notification  letters,  or  withholding  of 
wages  and  tax  refunds)  to  encourage  or  garner  payment  from  probationers  with  amounts 
past  due. 

The  report  does  not  mention  that  APD  staff  has  been  talking  to  the  Franchise  Tax  Board 
regarding  collections  for  some  time.  When  it  finally  seemed  that  the  FTB  and  the  APD  were 
ready  to  contract,  a new  State  administration  was  elected.  A State  appointee  to  FTB  had  not 
occurred  thus  negotiations  with  that  agency  were  stalled  . New  discussions  are  being 
attempted  to  negotiate  a contract  pending  renegotiation  of  fees  charged  by  FTB  for  collection. 

47.  Page  35:  Neither  the  former  nor  the  current  business  manager  could  explain  why 
the  Department  no  longer  participates. 

According  to  the  current  Business  Manager,  the  Department  is  now  in  the  process  of  signing  an 
agreement  to  participate  in  both  the  tax  intercept  program  and  the  FTB’s  debt  collection 
program.  Please  note  that  we  initially  met  with  the  debt  collection  program  staff  two  years  ago. 
Shortly  after  our  meeting,  they  stopped  taking  on  clients — the  program  was  being  evaluated  for 
effectiveness  by  the  State. 
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48.  Page  35:  We  found  that  at  least  three-quarters  of  cases  owing  money  complete 
their  probation  terms  with  amounts  still  due.  The  Department  has  a policy  from  1983 
prohibiting  probation  officers  from  closing  cases  at  the  ends  of  their  probation  terms 
unless  probationers  meet  their  financial  obligations,  but  the  Department  no  longer 
enforces  this  rule. 

Unfortunately,  this  statement  has  merit;  however,  the  Department  is  developing  a newly 
reformed  policy  and  procedure  that  will  not  allow  cases  to  terminate  probation  without 
probationers’  fulfillment  of  financial  responsibilities.  We  are  also  including  a note  with  our 
recommendations  that  civil  judgments  against  probationers  be  imposed  in  the  event  that 
probationers  fail  to  meet  their  financial  obligations  during  their  periods  of  probation.  This  will 
allow  the  Department  to  collect  fees  beyond  the  term  of  probation. 

49.  Page  36:  Private  companies  also  offer  collection  services... 

The  Department  has  been  negotiating  with  GS  Services  for  over  one  year  to  obtain  their 
services  as  a private  collection  agency.  Since  they  are  based  in  Texas,  they  were  not  willing  or 
able  to  meet  the  City’s  12b  compliance  rule  (domestic  partners). 

50.  Page  36:  The  State  Board  of  Control  has  money  available  through  its  Revenue 
Recovery  and  Compliance  Division  to  fully  fund  positions  to  help  counties  increase  their 
collection  of  restitution.  The  District  Attorney’s  Office  has  one  such  position,  a 
restitution  specialist,  on  staff  currently  and  has  been  helping  the  Department  apply  for 
similar  funding. 

The  APD  has  been  gathering  information  about  applying  for  a position  funded  by  the  SBOC.  We 
will  be  submitting  our  letter  of  interest  to  the  new  department  head  in  the  near  future.  We  are 
working  with  SBOC  specialist  assigned  to  the  District  Attorney’s  Office,  to  formulate  the  letter  in 
the  best  way  possible  to  give  us  the  best  chance  possible  to  gain  funding  for  such  a position. 

51.  Page  38:  At  the  time  of  this  audit,  the  [investigations]  division  had  a total  of  27 
probation  officers  organized  into  three  units. 

@ There  are  23  investigating  officers  in  the  investigations  unit,  including  2 vacant  positions. 

CHAPTER  3:  DATA  COLLECTIONS  AND  REPORTS 

52.  Page  40:  Although  the  division  generally  delivers  presentence  reports  to  the 
Court  on  time,  Exhibit  16  shows  that  continuances  requested  as  a percentage  of 
presentence  reports  requested  increased  between  January  1998  and  November  1999. 

Exhibit  16  reveals  the  percentages  and  a trend  line  that  would  appear  to  indicate  an  increase. 

^ When  the  raw  numbers  are  examined,  it  is  apparent  that  continuances  are  not  rising  as  a 

percentage  of  pre-sentence  reports  requested.  For  fiscal  year  1998-99,  the  division  produced  a 
total  of  3,918  reports  and  there  were  713  continuances  resulting  in  a rate  of  18.2%.  For  fiscal 
year  1999-00,  the  division  produced  a total  of  3,604  reports  and  there  were  645  continuances 
resulting  in  a rate  of  17.9%.  The  actual  trend  line  regarding  continuances  is,  therefore,  flat. 
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53.  Page  41 : Although  the  division  tracks  the  number  of  continuances  it  requests 
each  month,  it  does  not  analyze  the  information  on  the  request  form. 

The  division  does  track  continuances  monthly  and  the  monthly  report  prepared  for  the  chief 
breaks  them  down  by  the  reasons  for  continuances. 

54.  Page  41 : We  tested  the  division’s  statistics  for  total  reports,  late  reports,  and 
continuances  and  found  discrepancies  between  what  the  division  reported  and  our 
results... 

When  examining  thousands  of  cases  using  multiple  tracking  systems,  a small  margin  of  error  is 
likely  to  be  found  in  most  instances.  For  example,  when  comparing  the  number  of  reports 
assigned  between  January  1998  and  June  1999,  the  division  reported  5,625  reports  assigned 
to  probation  officers  while  the  division’s  database  showed  5,754  reports  had  been  assigned, 
revealing  a difference  of  129  reports.  This  translates  into  an  error  rate  of  2.2%. 

In  a similar  vein,  the  division  reported  continuances  for  the  period  January  1998  through  June 
1999  totaled  973,  whereas  the  audit  team  tabulated  continuances  for  the  same  period  and 
found  998,  a difference  of  25  continuances.  This  translates  into  an  error  rate  of  2.5%, 
assuming  the  audit  team  performed  a complete,  case-by-case  review  as  opposed  to  relying 
upon  a methodology  based  on  estimation. 

We  question  if  margins  of  error  between  2.2%  and  2.5%  provide  sufficient  cause  to  conclude 
that  the  division’s  statistics  are  unreliable. 

55.  Page  41:  Because  the  division’s  statistics  are  unreliable,  we  developed  our  own 
methodology  to  arrive  at  the  numbers  of  reports  assigned,  reports  delivered  late,  and 
continuances  requested. 

The  methodology  developed  by  the  audit  team  to  arrive  at  what  they  deem  to  be  accurate 
figures  cannot  be  addressecf  because  it  is  insufficiently  outlined  in  the  report.  The  methodology 
appears  to  be  estimations  based  on  samples,  some  of  which  may  have  been  very  small  in  size, 
as  was  the  case  in  several  other  instances  where  samples  were  relied  upon.  No  explanation  is 
provided  for  how  auditors  calculated  the  number  of  late  reports  in  four  sample  months  in  the 
fiscal  year  1997-98. 

56.  Page  42:  During  our  review,  the  division  was  testing  and  preparing  to  implement 
an  enhanced  database  system...  If  used  to  its  fullest  capacity,  the  new  system  should 
minimize  reporting  errors  and  improve  the  quality  and  content  of  performance  data 
available  to  the  division.  However,  as  in  the  case  of  the  old  system,  the  division  faces 
the  risk  of  failing  to  take  advantage  of  the  new  system’s  capabilities. 

The  department  intends  to  take  full  advantage  of  the  new  system’s  capabilities. 
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CHAPTER  4:  PLANNING  AND  REPORTING  PROCESSES 

57.  Page  48:  Based  on  our  discussions  with  the  Department  and  documents  it 
provided,  we  determined  that  the  Department  does  not  have  a clear  understanding  of  the 
strategic  planning  process  and  thus  cannot  comply  with  the  requirement  in  the  near 
future. 

Strategic  planning  has  been  used  consistently  throughout  this  administration  to  deal  with 
complex  problems  that  surfaced  early  in  this  administration’s  leadership.  Within  the  first  six 
months  in  office,  the  current  chief  learned  that  the  Department’s  $5,000,000  federal  Network 
grant  was  in  jeopardy  2 V2  years  into  the  grant.  It  had  not  been  adequately  implemented. 
Representatives  from  the  United  States  Department  of  Health  and  Human  Services  indicated 
we  would  lose  funding  unless  significant  changes  occurred  to  improve  the  strategy  to  meet  the 
grant’s  goals  and  objectives.  The  chief  developed  a strategic  plan  that  resulted  in  the 
successful  implementation  of  the  goals  and  objectives.  This  included  collaborating  with  other 
outside  agencies,  working  closely  with  the  Mayor’s  Criminal  Justice  Council,  and,  as  chair  of  the 
policy  committee  that  oversees  the  grant,  the  chief  began  holding  regular  meetings  with 
members  of  the  Council.  At  the  same  time,  the  Department  worked  very  closely  with  evaluators 
from  the  University  of  California  at  San  Francisco  to  coordinate  efforts  to  improve  data 
collection  and  to  ensure  quality  services  to  the  female  population  upon  whom  the  grant  focused. 
After  two  years  of  intensive  strategic  planning  and  implementation,  the  Department  was 
acknowledged  by  those  at  the  federal  level  as  having  met  the  grant’s  goals  and  objectives  and 
in  exceeding  the  timetable  for  doing  so.  As  a result  of  these  successes,  we  implemented  a 
strategic  plan  to  solicit  additional  federal  funding  in  the  amount  of  $990,000  for  an  additional 
year  to  support  the  grant,  which  we  were  awarded. 

Furthermore,  the  same  strategic  planning  process  was  used  during  two  consecutive  budget 
years  under  this  administration  with  the  development  and  implementation  of  equitable  policies 
and  procedures.  Together,  the  chief  and  senior  managers  discuss  goals  and  attendant 
objectives  annually  and  thoroughly  review  progress  toward  them  biannually.  Activities  or 
progress  related  to  individual  goals  and  objectives  are  reviewed  on  an  ongoing  basis  during 
senior  staff  meetings.  Toward  the  end  of  the  fiscal  year,  the  chief  reports  to  what  degree  senior 
staff  actually  met  goals.  The  report,  instituted  in  the  past  couple  of  years,  is  submitted  to  the 
Department  of  Human  Resources. 

The  Domestic  Violence  Unit  developed  and  implemented  policies  and  procedures  to  enhance 
community-base'  providers,  as  prescribed  by  law. 

The  Task  Force  has  been  diligent  in  its  efforts  to  address  the  identifying  problems  within  the 
Department  and  has  influenced  effective  change  to  resolve  those  issues  identified  by  the  data. 
Among  the  changes  that  have  occurred  as  a result  of  the  ongoing  efforts  of  the  Task  Force  are 
the  following: 
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• Implementation  of  a new  file  tracking  system  using  San  Francisco  numbers; 

• Remodeling  of  the  Front  Desk  and  upgrading  of  the  computers; 

• Centralized  filing  system  using  the  bar  coding  system  to  track  files,  thus  avoiding  the 
practice  of  file  duplication; 

• Upgrading  and  distributing  personal  computers  for  all  probation  officers; 

• Automation  of  the  assignment  system  in  Investigation; 

• Fully  equipping  the  ISU  with  safety  equipment  to  perform  the  responsibilities  with  a higher 
degree  of  safety; 

• Development  of  Escalation  of  Force  policy  and  procedure,  including  staff  training  in  the  use 
of  force; 

• Development  of  a Transfer  Policy  that  is  fair  and  equitable  to  all  staff; 

• Internet  access  for  staff  to  do  research; 

• E-mail  services  for  better  communication  among  staff  members; 

• Development  of  a Training  and  Orientation  Program  for  newly  appointed  probation  officers: 

• Development  of  an  upcoming  formalized  training  for  all  probation  officers  regarding  use  of 
the  Risk  Needs  Assessment; 

• Development  of  an  Emergency  Response  Team  that  is  soon  to  be  implemented; 

• Centralized  telephone  system  for  the  Front  Desk; 

• Posting  of  all  administrative  and  management  minutes,  making  review  by  all  staff  members 
possible; 

• Adoption  of  formalized  identification  cards  for  safety  purposes;  and 

• Holding  general  staff  meetings  twice  annually  to  keep  staff  informed  of  the  budget  process. 

Although  the  planning  process  does  not  yet  exist  in  policies  and  procedures,  senior  staff 
members  are  an  integral  part  of  the  budget  planning  and  preparation  process.  Every  year 
under  this  administration,  senior  staff  meets  for  a full  day  prior  to  beginning  the  budget  process. 
The  chief  outlines  each  senior  staff  member’s  position  regarding  the  budget,  after  which  each 
member  presents  individual  needs  and  they  meet  again  to  prioritize  needs.  When  the  budget 
package  is  developed  in  January,  it  is  presented  to  middle  management  after  which  it  is 
presented  one  more  time  at  a mandatory  meeting  for  all  staff.  An  open  question  and  comment 
period  is  part  of  the  middle  management  and  department-wide  presentations. 

Most  APD  staff  had  not  been  involved  in  strategic  planning  activities  prior  to  this  administration. 
Strategic  planning  is  a sophisticated  process  that  includes  steps  that  build  one  upon  another. 
Although  required,  not  an  effective  process  without  sufficient  training.  This  year  senior  staff 
received  training  in  strategic  planning.  As  can  be  seen,  strategic  planning  has  been  utilized  to 
deal  with  internal  issues  in  the  recent  past,  and  the  process  will  continue  to  be  expanded  in  the 
future  to  serve  the  range  of  Department  operations. 

58.  Page  48:  When  asked  In  our  employee  survey  whether  the  Department  has  a 
strategy  in  place  for  future  growth  and  improvement,  45%  of  the  85  respondents 
disagreed  or  strongly  disagreed;  24%  were  not  sure.  Staff  members  who  do  not  know 
where  the  Department  is  heading  cannot  help  effectively  to  get  it  there. 
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Each  of  the  survey  respondents  was  asked  to  identify  themselves  as  line  staff,  administrative, 
or  management/supervision  staff,  yet  survey  results  were  not  presented  in  disaggregate  form. 
While  it  is  reasonable  to  expect  that  senior  management  and  supervisory  staff  would  be  aware 
of  such  a strategy,  it  is  not  necessarily  the  case  with  line  staff,  particularly  in  a department  such 
as  this  one  that  had  undergone  a recent  change  of  management. 

59.  Page  48:  The  Department’s  changing  mission  statements  over  time  reflect  the 
absence  of  a clear,  compelling  vision. 

The  final  sentence  of  the  subse^ion  indicates  that  the  Department  does  now  have  an 
acceptable  mission  statement.  It  reads:  “Although  in  the  past  the  dept  has  had  varying  mission 
statements,  its  most  recent  missi  statement  from  its  fiscal  year  2000-01  budget  is  more 
appropriate:  ‘to  serve  and  protect  the  citizens  of  the  City  and  County  of  San  Francisco  through 
investigation  and  supervision  of  adult  criminal  offenders.’” 

The  mission  of  the  Department  is  to  diverge  from  “bunker  supervision”— the  traditional  form  of 
Adult  Probation  Department  supervision  in  San  Francisco — to  a supervision  model  that  is  more 
field-  and  community-based. 

60.  Page  52:  According  to  the  chief  adult  probation  officer,  he  does  not  regularly  use 
or  rely  on  internal  reports  or  data  in  overseeing  the  Department’s  operations. 

In  a series  of  interviews  with  the  Chief  relatively  early  in  the  ten-month  audit  process  focused  on 
many  issues  relative  to  department  operations,  his  actual  comments  and  the  context  in  which 
they  were  provided  are  not  provided  in  the  report.  The  statement  takes  those  comments  out  of 
context.  More  accurately,  budgetary  reports  are  provided  to  the  chief  monthly  and  upon 
request  at  any  given  time.  Other  reports  regularly  provided  the  chief  include  information  from 
the  investigations  division  regarding  the  number  and  reasons  for  continuances,  late  reports,  and 
the  number  of  probation  reports  completed.  Also  available  to  the  chief  is  data  that  allows  him  to 
determine  how  many  sex  offender  cases  have  been  assigned  and  specific  crimes  that  have 
occurred.  Biweekly  reports  are  provided  regarding  the  number  of  reports  handled  by  the 
Transcription  Division.  The  Personnel  Manager  provides  weekly  personnel  reports  regarding 
the  areas  in  which  vacancies  exist,  hiring  process  reports,  specific  personnel  disciplinary 
actions,  employee  relations,  etc. 

61 . Page  52:  Under  the  previous  chief  and  for  about  a year  of  the  current  chiefs 
tenure,  senior  managers  were  required  to  report  monthly  statistics  on  the  activities 
under  their  direction.  By  December  1998,  however,  the  current  chief  had  ceased  to  ask 
for  most  regularly  scheduled  reports,  receiving  only  monthly  reports  about  total 
collections.  The  chief  explained  to  us  that  he  did  not  feel  that  compiling  reports  made 
effective  use  of  his  staffs  time  and  that  he  could  ask  for  information  if  he  needed  it.  As 
a result,  the  chief  does  not  receive  management  information  regularly  on  the 
Department’ s primary  activity — the  supervision  of  probationers. 
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Again,  the  chiefs  comments  were  paraphrased  rather  than  quoted.  The  chief  has  weekly 
meetings  with  directors,  once  monthly  meetings  with  supervisors,  and  minutes  are  taken  and 
posted  of  all — giving  ample  opportunity  for  everyone  with  an  interest  in  these  matters  to  be  kept 
apprised.  The  reports  the  chief  receives  regularly  are  presented  in  the  response  to  #60.  Based 
on  an  interview  with  the  chief  and  no  observations  of  management  or  supervisor  meetings,  the 
conclusion  that  the  chief  does  not  receive  management  information  appears  to  be  inaccurate. 

62.  Page  52:  For  several  months  in  1999,  the  Department’s  senior  cashier  compiled 
and  distributed  to  senior  managers  data  on  the  number  of  open  cases  that  owed  money 
but  that  had  unusable  addresses.  However,  according  to  the  cashier,  no  one  showed 
interest  in  the  report  so  she  stopped  producing  it. 

This  report  is  distributed  to  supervisors  and  probation  officers  on  a monthly  basis,  and  has  been 
for  some  time.  It  is  also  provided  to  the  division  directors  and  to  the  chief.  It  is  reviewed  and 
discussed  on  a monthly  basis. 

63.  Page  66:  The  preceding  chapters  describe  serious  ramifications  of  senior 
management’s  limited  efforts  to  evaluate  and  report  on  the  Department’s  work...  Senior 
management  is  unable  to  track  the  Department’s  performance  or  isolate  the  sources  of 
problems  that  arise.  Moreover,  without  regular  information  about  the  Department’s 
operations,  senior  management  increases  its  chances  of  failing  to  notice  issues  until 
they  are  crises  and  of  making  inappropriate  or  ineffective  decisions  about  departmental 
issues. 

This  conclusion  is  based  on  findings  that  have,  one  by  one,  been  discussed.  The  audit  touched 
on  many  important  points.  Throughout  this  response,  we  have  attempted  to  address  important 
issues  identified  by  the  Office  of  the  Controller’s  audit  of  this  Department  by  providing  more  in- 
depth  and  precise  information  to  augment  their  findings.  It  is  the  Adult  Probation  Department’s 
intent  to  address  the  issues  raised  by  the  report  and  to  continue  to  move  the  Department 
forward  under  new  leadership. 


AC:hbm 

chief 
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COMMENTS 

CONTROLLER’S  AUDITS  DIVISION  COMMENTS  ON  THE 
RESPONSE  FROM  THE  ADULT  PROBATION  DEPARTMENT 


To  provide  clarity  and  perspective,  we  are  commenting  on  the  response  to 
our  audit  report  from  the  San  Francisco  Adult  Probation  Department 
(Department).  The  following  numbers  correspond  to  the  numbers  we  have 
placed  in  the  Department’s  response. 


© 


© 
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The  findings  the  Department  cites  here  refer  to  management’s  use  of 
information  on  the  overall  functions  of  the  Department,  including  probationer 
supervision,  and  not  to  performance  appraisals  of  individual  employees.  We 
have  modified  the  report  to  clarify  the  meaning  of  “performance  data.” 

We  randomly  selected  our  sample  of  207  probation  cases  from  the  population  of 
all  cases  ordered  to  probation  with  the  Department  between  July  1995  and 
December  1999.  Of  the  207  probation  cases  reviewed,  only  38  cases  were  both 
open  and  classified  as  maximum  risk. 

Whenever  one  takes  a sample  of  an  entire  population — whether  that  population 
is  people,  files,  or  some  other  entity — the  larger  the  sample  size,  the  more 
accurately  the  entire  population  is  reflected  in  the  results.  However,  small 
sample  sizes  are  routinely  used  to  draw  conclusions  about  a population  as  a 
whole.  Statistically  valid  U.S.  Presidential  polls  are  often  conducted  with  fewer 
than  1,000  people  out  of  the  entire  eligible  voting  population.  Nonetheless,  the 
goal  of  our  analyses  in  this  report  was  not  statistical  validity.  Rather,  our  intent 
was  to  look  at  enough  cases  to  reveal  potential  areas  of  concern  within  the 
Department. 

The  audit  report  does  not  argue  with  the  Department’s  decision  to  adopt  the 
practice  of  banking  probation  cases  or  with  the  number  of  cases  it  intends  to 
bank.  Rather,  the  report  highlights  weaknesses  in  how  the  Department  plans  to 
carry  out  its  banking.  As  we  note  on  page  21  of  the  report,  . .probation 
agencies  typically  provide  some  means  to  ensure  that  probationers  [in  banked 
caseloads]  comply  with  the  conditions  of  their  probation.”  We  confirmed  this 
statement,  which  is  contrary  to  the  Department’s  original  banking  policy,  in 
follow-up  phone  calls  to  the  jurisdictions  we  surveyed. 

Regarding  San  Bernardino’s  use  of  a large  banked  caseload,  we  cited  it  as  an 
example  of  a probation  department  that  restructured  itself  in  an  effort  to  cope 
with  rising  caseloads.  We  did  not  argue  for  or  against  the  Department’s 
adopting  this  model. 
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(j)  In  response  to  earlier  concern  expressed  by  the  Department  on  this  issue,  we  did 
gather  information  about  specialized  units  in  other  jurisdictions.  We  called  the 
1 1 probation  departments  included  in  our  benchmarking  survey  and  managed  to 
conduct  follow-up  interviews  with  8 of  them.  All  8 of  the  probation  departments 
manage  specialized  caseloads  and  at  least  5 have  limits  on  the  maximum 
number  of  cases  allowed  in  those  caseloads.  Through  its  own  research,  the 
Department  found  similar  results,  as  depicted  in  Table  2 of  its  response.  Our 
conclusion  is  that  San  Francisco  is  not  significantly  different  from  other 
counties  in  its  use  of  specialized  caseloads 

(g)  In  Appendix  B of  the  report,  we  describe  our  methodology  for  selecting  the 
benchmarking  jurisdictions,  which  included  both  peer  jurisdictions  and 
probation  departments  known  for  their  best  practices  in  managing  probation 
cases.  On  page  18  of  our  report,  we  acknowledge  that  there  are  differences 
among  the  counties  we  included  in  our  survey,  but  we  believe  the  information 
presented  is  broadly  representative  of  adult  probation  functions  in  California 
and  around  the  country.  Comparisons  to  other  jurisdictions  provide  San 
Francisco  with  a rough  gauge  of  its  place  among  other  counties  regarding 
staffing  and  demand  for  services.  This  sort  of  comparison  is  especially 
important  for  functions  such  as  probation  where  industry  standards  for  workload 
and  service  levels  are  lacking.  We  believe  that  our  analysis  concludes  fairly  that 
staffing  in  San  Francisco  Adult  Probation  is  comparable  to  the  other  counties. 
However,  it  is  important  to  note  that  our  report  includes  other  analyses  of  the 
Department,  and  that  we  took  all  of  these  analyses  into  account  in  drawing  our 
conclusions  about  the  workload  of  the  Department. 

(g  On  page  12  of  the  report,  we  note  that  neither  of  the  caseload  totals  the 

Department  shows  in  its  spreadsheet  each  month  may  be  accurate.  The  error  rate 
between  the  two  caseload  totals  has  little  importance  because  we  have  no  proof 
that  either  total  is  accurate.  The  report  discusses  the  discrepancy  between  the 
two  caseloads  totals  to  illustrate  that  the  Department’s  system  of  tabulating  and 
reporting  its  monthly  caseload  numbers  is  prone  to  error. 

Q We  provided  all  information  the  Department  requested  regarding  the  results  of 
our  written  survey  of  benchmarking  jurisdictions.  Since  the  survey  addressed 
many  topics  outside  of  the  Department’s  request,  we  sent  the  Department  the 
survey  responses  for  only  those  questions  pertaining  to  the  staffing  and  case 
management  issues  it  expressed  interest  in.  At  that  time  we  informed  the 
Department  that  we  were  willing  to  provide  survey  results  in  the  other  topic 
areas  if  it  wished.  We  received  no  additional  requests  from  the  Department  for 
survey  information. 

g,  It  is  difficult  to  understand  the  figures  the  Department  reports  in  its  response 
and  why  those  figures  differ  from  our  data  and  findings.  We  reviewed  written 
probation  orders  from  the  Court  for  all  207  probationers  in  our  sample  and 
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found  that  76  had  court  orders  to  register  with  the  police  department  as  sex, 
drug,  or  arson  offenders.  We  gave  the  list  of  76  probationers  to  an  officer  in  the 
San  Francisco  Police  Department’s  Identification  Unit  who  checked  the 
registration  database  to  see  which  of  the  76  probationers  were,  in  fact, 
registered.  For  the  32  he  found  to  be  registered,  he  provided  the  date  of 
registration.  For  those  not  found  in  the  computer,  he  checked  the  registration 
paper  files  and  located  one  additional  registrant  for  a total  of  33  probationers 
who  were  actually  registered.  That  left  43  probationers  in  our  sample  who  had 
not  registered  although  ordered  by  the  Court  to  do  so.  Furthermore,  when  we 
selected  our  sample,  we  attempted  to  eliminate  those  cases  in  certain  caseloads 
and  programs,  including  drug  court  and  drug  diversion,  because  our  preliminary 
testing  showed  those  case  files  would  contain  limited  information  for  review. 
Therefore,  we  believe  the  Department’s  concern  about  drug  diversion  cases’ 
biasing  our  finding  is  unwarranted. 

The  Controller’s  Audits  Division  acknowledges  and  appreciates  the 
Department’s  efforts,  at  all  levels,  to  cooperate  with  our  requests  throughout  the 
period  of  the  audit.  In  the  specific  instance  the  Department  cites,  the  five  cases 
were  part  of  the  sample  of  225  randomly  selected  case  files  the  audit  team 
requested  the  Department  to  provide  it  for  review.  As  we  note  on  page  9 of  the 
report,  the  Department  was  able  to  provide  us  with  most  of  the  case  files.  For 
the  files  it  could  not  provide,  the  Department  explained  to  us — in  writing — that 
the  files  were  “lost”,  “not  found”,  or  that  the  probation  officer  “does  not  know 
where  [the]  file  is.” 

See  comment  6. 

See  comment  8. 


The  meaning  of  these  and  related  findings  is  that  department  management  has 
not  made  efficient  use  of  its  current  staff  and  has  been  slow  to  respond  to  long- 
standing workload  and  staffing  concerns. 


Although  there  may  be  constraints  on  the  extent  to  which  the  Department  may 
be  able  to  utilize  additional  support  administrative  staff,  we  believe  the 
Department  should  explore  its  options.  We  support  department  efforts  to  bring 
creativity  to  bear  on  its  workload  issues  as  have  other  jurisdictions. 

The  statement  to  which  the  Department  refers  can  now  be  found  on  pages  20 
and  21  of  the  report. 


The  report’s  statement  about  maximum-risk  cases  in  the  banked  caseload  is 
based  on  department  documentation  and  statements  from  a division  director.  On 
July  1 9,  2000,  auditors  visited  the  Department  to  review  its  banking  policy  and 
related  reorganization  plan.  A division  director  explained  both  to  the  auditors. 
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The  plans  the  auditors  reviewed  included  the  establishment  of  new  caseloads 
numbered  13,  20,  and  99.  The  plans  stated  that  caseload  20  would  be  for 
medium  risk  cases  that  were  banked,  caseload  99  would  be  for  minimum  risk  or 
unclassified  cases  that  were  banked,  and  caseload  13  would  be  for  maximum 
risk  cases  that  were  banked.  The  division  director’s  explanation  corroborated  the 
plans  the  auditors  reviewed. 


The  statement  to  which  the  Department  refers  can  now  be  found  on  page  21  of 
the  report. 

The  form  letter  the  Department  sends  to  probationers  whose  cases  it  is  banking 
states,  in  part,  “There  will  be  no  probation  officer  assigned  to  supervise  you. 
You  are  no  longer  required  to  report  to  the  Adult  Probation  Department. . . .If 
you  have  been  ordered  to  register  as  a Drug  Offender  per  Section  11590  PC  or  a 
Sex  Offender  per  Section  290  PC  or  as  an  Arsonist  per  Section  457.1  PC,  you 
must  register  and  update  your  registration  with  the  Police  Department  or 
Sheriffs  Office  where  you  reside.”  It  is  apparent  that  the  Department  has 
planned  to  include  in  the  banked  caseload  probationers  required  to  register  for 
sex,  drug,  and  arson  offenses. 


The  current  chief  adult  probation  officer  took  charge  in  August  1997.  The 
efforts  the  Department  notes  in  its  response  began  in  the  spring  of  2000,  more 
than  two  and  one-half  years  into  the  current  administration.  On  page  65  of  the 
report,  we  note  that,  as  of  May  2000,  the  majority  of  policies  and  procedures  in 
the  Department’s  manual  are  more  than  ten  years  old.  These  include  virtually  all 
policies  dealing  with  supervision  of  probationers,  such  as  “Classification  and 
Supervision  of  Probationers”  (1983),  Motions  to  Modify,  Revoke  or  Terminate 
Probation”  (1983),  and  “New  Arrests  of  Persons  on  Probation”  (1985). 

The  statement  to  which  the  Department  refers  can  now  be  found  on  page  22  of 
the  report. 

The  audit  report  describes  methods  and  innovations  of  other  jurisdictions  as 
examples  only,  not  as  models  to  follow  exactly.  The  intent  is  to  encourage  the 
Department  to  explore  alternative  approaches  to  cope  with  their  workload 
challenges  as  has  been  implemented  in  whole  or  in  part  elsewhere.  The 
statement  to  which  the  Department  refers  was  part  of  our  discussion  of  how 
other  probation  departments  that  bank  cases  typically  provide  some  means  to 
ensure  that  probationers  comply  with  conditions  of  their  probation.  Regardless 
of  the  specifics  in  San  Bernardino,  randomly  selecting  banked  cases  to  review 
for  compliance  can  be  an  effective  method  to  leverage  scarce  staff  resources 
while  maintaining  some  measure  of  oversight.  At  the  time  it  was  implemented, 
San  Francisco’s  banking  procedure  had  no  such  provision  for  monitoring  or 
review  of  cases  in  its  banked  caseload. 
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The  statement  to  which  the  Department  refers  can  now  be  found  on  page  22  of 
the  report. 


We  support  the  Department  in  its  decision  to  implement  an  adjustment  to  their 
banking  policy  and  procedure  to  conduct  random  checks  of  banked  cases.  The 
original  policy  left  probationers  in  the  banked  caseload  with  no  oversight  and 
provided  no  means  for  returning  a case  to  active  supervision  prior  to  a 
reoffense.  It  is  important  to  note  that  the  Motion  to  Review  unit  responds  only 
after  a probationer  in  the  banked  caseload  is  arrested,  the  District  Attorney  has 
decided  to  prosecute,  and  the  Court  requests  from  the  Department  a report  on 
the  offender.  Under  the  original  policy,  the  Department's  daily  duty  officer  was 
responsible  only  for  dealing  with  probationers  who  come  to  the  office  or  phone 
in,  not  systematically  reviewing  cases  for  compliance  or  other  risk  factors. 


As  we  indicate  in  comments  15  and  19,  the  examples  of  operations  in  other 
jurisdictions  are  meant  to  be  a source  of  ideas  and  techniques  for  developing 
solutions  appropriate  for  San  Francisco.  We  encourage  the  Department  to  work 
further  toward  overcoming  what  it  sees  as  constraints  to  implementing  the 
changes  necessary  to  carry  out  its  mission  most  effectively. 


The  statement  to  which  the  Department  refers  can  now  be  found  on  page  23  of 
the  report. 


According  to  the  Los  Angeles  County  Probation  Department  Web  site,  its 
“force  of  more  than  1400  volunteers  provides  a variety  of  services  to  juvenile 
and  adult  probationers  at  virtually  every  work  location.” 

The  report  does  not  dispute  that  total  collections  have  seen  a net  increase  since 
fiscal  year  1995-96.  On  page  29  of  the  report  we  raise  the  concern  that  the 
increase  in  dollars  collected  is  masking  a decrease  in  the  overall  collection 
rate — that  is,  the  proportion  of  the  total  amount  due  from  probationers  that  the 
Department  collects.  Our  analysis  illustrates  that  using  revenues  alone  to  gauge 
performance  can  provide  a misleading  picture  of  the  collection  function's 
effectiveness. 


On  page  3 1 of  the  report  w7e  acknowledge  that  probation  officers  and  unit 
supervisors  receive  monthly  reports  on  the  collection  status  of  their  probation 
cases.  These  reports  contain  large  amounts  of  raw-  data  pertaining  to  the  current 
month  only.  The  point  we  raise  on  page  30  of  the  report  is  that,  except  for 
information  on  monthly  revenues,  the  Department's  senior  managers  receive  no 
reports  of  analyzed  data  that  could  be  used  to  evaluate  the  Department's  overall 
collection  performance  and  to  implement  improvements.  As  we  mention  on 
page  54  of  the  report,  senior  managers  used  to  receive  monthly  reports  on  the 
number  of  bad  addresses  in  each  caseload.  However,  the  report  was 
discontinued  after  several  months  due  to  lack  of  interest. 
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On  page  30  of  the  report  we  summarize  the  method  used  to  develop  the  estimate 
of  2,000  cases  missing  from  the  Department’s  accounting  system.  To  be  more 
specific,  we  reviewed  the  probation  orders  for  207  randomly  selected  probation 
cases  and  found  that  in  92  percent  of  the  cases  the  Court  had  ordered  the 
probationer  to  pay  a fine,  fee,  and/or  restitution.  Using  that  figure,  we  estimated 
that  about  9,500  of  the  Department’s  current  active  probation  cases  (10,400  x 
0.92)  received  similar  orders  from  the  Court  to  fulfill  one  or  more  financial 
obligations.  We  then  obtained  data  on  every  open  case  recorded  in  the 
accounting  system  and  found  approximately  7,500  cases  listed,  about  72  percent 
of  the  Department’s  total  active  caseload.  We  analyzed  the  Department’s 
process  for  handling  the  financial  obligations  of  probationers  and  determined 
that  the  accounting  system  should  include  a record  of  every  case  ordered  to  pay 
fines,  fees,  or  restitution,  regardless  of  whether  the  probation  officer  later 
waived  the  obligation.  As  such,  we  would  expect  records  for  about  9,500  cases 
to  be  present,  but  found  only  7,500 — a discrepancy  of  2,000  records. 


As  we  state  in  comment  2,  we  disagree  that  our  sample  sizes  are  too  small  to 
draw  meaningful  conclusions.  In  this  case,  we  corroborated  our  analysis,  which 
was  based  on  a random  sample  of  207  probation  cases,  with  a second,  more 
detailed  analysis  using  20  randomly  selected  probation  cases.  As  the  report 
indicates  on  page  30,  the  findings  from  the  second  test  support  those  from  the 
analysis  based  on  the  larger  sample  size. 


Please  see  comment  26.  We  contend  that  probation  officers  and  unit  supervisors 
receiving  reports  of  raw  data  pertaining  to  the  current  month  only  is  not  the 
same  as  tracking  collection  data  on  a division,  unit,  or  probation  officer  level. 
Tracking  data  over  time  and  arraying  it  so  that  comparisons  can  be  made 
between  probation  officers,  units,  and  divisions  would  allow  the  Department  to 
identify  trends  and  areas  in  need  of  attention. 

The  two  cases  described  are  examples  from  the  review  of  case  files,  not  a 
statistical  sample. 


On  page  35  of  the  report  we  note  that  the  Department  has  met  with  various 
collection  agencies,  including  the  Franchise  Tax  Board,  since  November  1997 
to  discuss  collecting  from  delinquent  probationer  accounts. 


The  statement  to  which  the  Department  refers  can  now  be  found  on  page  40  of 
the  report. 

At  the  time  we  obtained  staffing  information,  the  Investigations  Division  stated 
it  had  27  probation  officers,  including  3 supervising  probation  officers,  1 part- 
time  officer,  and  2 vacancies.  The  Department’s  figure  of  23  probation  officers 
appears  to  exclude  the  3 supervising  probation  officers  and  possibly  a part-time 
officer  whom  we  included  in  our  total  of  27  probation  officers. 
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The  statement  to  which  the  Department  refers  can  now  be  found  on  page  42  of 
the  report. 


For  fiscal  year  1998-99,  our  data  show  that  continuances  as  a percentage  of  total 
presentence  reports  equaled  18.5  percent.  Our  analysis  did  not  look  at  data 
beyond  November  1999,  so  we  are  not  able  to  show  continuances  as  a 
percentage  of  presentence  reports  for  all  of  fiscal  year  1999-2000.  However,  for 
the  months  from  July  1999  through  November  1999,  our  data  show 
continuances  were  17.8  percent  of  total  presentence  reports.  Although  our 
calculations,  18.5  percent  and  17.8  percent,  approximate  the  Department’s 
calculations  and  may  indicate  there  has  been  little  change  when  comparing 
fiscal  years,  our  conclusion  that  continuances  are  increasing  is  based  on  an 
analysis  of  the  monthly  variations  in  continuances  as  a percentage  of  total 
presentence  reports  from  January  1998  through  November  1999.  By  analyzing 
month-to-month  changes  in  continuances  as  a percentage  of  total  presentence 
reports,  the  trend  that  emerges  is  one  that  is  generally  increasing.  Only 
comparing  two  points  of  data,  fiscal  year-end  to  fiscal  year-end  as  the 
Department  has  done,  does  not  provide  sufficient  information  for  detecting  a 
trend  over  time. 

The  statement  to  which  the  Department  refers  can  now  be  found  on  page  43  of 
the  report. 

We  requested  from  division  staff  and  from  the  chief  adult  probation  officer  any 
statistics  and  reports  the  Investigations  Division  produced  on  its  activities.  We 
were  provided  with  statistics  showing  total  monthly  continuances,  but  this 
information  did  not  include  reasons  why  continuances  were  being  requested. 
Even  if  this  information  is  reported  each  month,  our  conclusion  that  the 
Department  does  not  analyze  this  information  still  pertains.  As  our  report  states, 
“Compiling  and  analyzing  information  about  the  circumstances  resulting  in 
continuances  or  the  characteristics  of  the  cases  or  offenders  could  help  the 
division,  the  Court,  and  law  enforcement  agencies  identify  trends  and  provide 
insight  into  ways  to  limit  continuances.” 

The  statement  to  which  the  Department  refers  can  now  be  found  on  page  43  of 
the  report. 

Our  conclusion  that  the  Investigations  Division’s  statistics  are  unreliable  is  not 
based  only  on  the  differences  between  what  the  division’s  statistics  showed  and 
what  we  found  through  other  means.  Our  conclusion  was  also  based  on  tests  of 
the  division’s  statistics  where  we  found  we  could  not  verify  the  figures  reported 
by  the  division.  As  we  state  in  the  report,  “The  data  discrepancies  we  found 
appear  to  derive  from  inconsistencies  in  the  ways  staff  compiles  statistics, 
manual  computational  processes  that  are  prone  to  error,  and  management’s  lack 
of  verification  of  data.” 
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The  statement  to  which  the  Department  refers  can  now  be  found  on  page  43  of 
the  report. 


To  the  extent  possible,  we  relied  on  complete  sets  of  data  in  developing  our 
findings  regarding  the  Investigations  Division.  For  example,  we  manually 
counted  all  continuance  forms  for  the  audit  period,  and  we  validated  the  data  in 
the  division’s  database  of  reports  assigned  and  used  totals  from  the  system  in 
our  analyses. 

In  our  analysis  of  late  reports,  we  developed  an  appropriate  methodology  for 
calculating  the  numbers  of  late  reports.  Because  developing  monthly  statistics 
for  late  reports  for  every  month  of  the  three  years  of  our  audit  period  would 
have  required  extensive  manual  calculations,  we  extrapolated  the  numbers  and 
percentages  of  late  reports  using  a sample  of  months  in  each  of  the  three  years. 
Comparing  delivery  dates  hand  written  into  the  division’s  logbook  to  the  dates 
the  reports  were  due  in  Court,  we  calculated  total  late  reports,  and  late  reports  as 
a percentage  of  total  reports  assigned,  for  four  selected  months  in  each  year  and 
extrapolated  the  results  to  each  year.  Our  method  is  described  in  detail  in  our 
audit  workpapers  and  is  available  for  review.  Although  this  method  may  not 
produce  precise  totals  of  late  reports  for  those  years,  we  are  confident  that  for 
the  purpose  of  our  analysis  our  calculations  are  reliable. 

The  statement  to  which  the  Department  refers  can  now  be  found  on  pages  48 
and  50  of  the  report. 

Although  the  Department  has  listed  worthwhile  achievements,  it  has  not 
presented  a comprehensive,  coherent  strategic  planning  process.  As  Exhibit  17 
shows  on  page  49  of  the  report,  strategic  planning  is  a forward-looking  process 
that  includes  certain  formal  steps.  It  is  concerned  with  the  overall  vision, 
mission,  goals,  objectives,  and  performance  measures  of  an  organization. 
Strategic  planning  includes  consideration  of  problem  areas  and  the 
organization’s  capacities  and  environment  (including  potential  risks).  To  be 
effective,  an  organization’s  vision,  mission,  objectives,  and  performance 
measures — those  elements  that  comprise  the  strategic  plan — must  be 
communicated  to  all  employees.  All  employees  should  be  unified  in  working 
toward  a departmental  vision  and  mission  and  should  be  aware  of  goals, 
objectives,  and  performance  measures  that  further  the  Department’s  strategic 
plan. 

The  statement  to  which  the  Department  refers  can  now  be  found  on  page  50  of 
the  report. 

The  mission  statement  we  cite  in  the  report  appears  in  the  Department’s  fiscal 
year  2000-01  budget  and  its  most  recent  annual  report.  The  statement  describing 
the  Department’s  diverging  from  one  supervision  model  to  another  is  not  one 
that  we  had  ever  heard  attributed  or  seen  documented  as  a mission  statement  for 
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The  statement  to  which  the  Department  refers  can  now  be  found  on  page  54  of 
the  report. 

We  have  modified  the  report  to  more  accurately  characterize  our  comments  in 
that  section.  The  report’s  finding  in  this  area  is  that  although  the  Department’s 
senior  management  holds  meetings,  the  effective  use  of  data  as  a management 
tool  is  also  necessary  for  keeping  informed  of  the  Department’s  activities.  In 
particular,  the  chief  probation  officer  receives  little  data  about  probationers  and 
their  supervision.  The  audit  report  states  that  management  reports,  to  be 
effective,  should  compare  data  over  time  and  should  form  the  foundation  of  the 
Department’s  assessment  of  whether  its  policies,  plans,  and  programs  are 
working. 


The  statement  to  which  the  Department  refers  can  now  be  found  on  page  54  of 
the  report. 


See  comment  26. 
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